Three-dimensional image volumes from two-dimensional digitally reconstructed radiographs: A deep learning approach in lower limb CT scans.
CNN
CT scan
image reconstruction
x ray
Journal
Medical physics
ISSN: 2473-4209
Titre abrégé: Med Phys
Pays: United States
ID NLM: 0425746
Informations de publication
Date de publication:
May 2021
May 2021
Historique:
revised:
01
03
2021
received:
08
07
2020
accepted:
03
03
2021
pubmed:
11
3
2021
medline:
25
5
2021
entrez:
10
3
2021
Statut:
ppublish
Résumé
Three-dimensional (3D) reconstructions of the human anatomy have been available for surgery planning or diagnostic purposes for a few years now. The different image modalities usually rely on several consecutive two-dimensional (2D) acquisitions in order to reconstruct the 3D volume. Hence, such acquisitions are expensive, time-demanding and often expose the patient to an undesirable amount of radiation. For such reasons, along the most recent years, several studies have been proposed that extrapolate 3D anatomical features from merely 2D exams such as x rays for implant templating in total knee or hip arthroplasties. The presented study shows an adaptation of a deep learning-based convolutional neural network to reconstruct 3D volumes from a mere 2D digitally reconstructed radiograph from one of the most extensive lower limb computed tomography datasets available. This novel approach is based on an encoder-decoder architecture with skip connections and a multidimensional Gaussian filter as data augmentation technique. The results achieved promising values when compared against the ground truth volumes, quantitatively yielding an average of 0.77 ± 0.05 structured similarity index. A novel deep learning-based approach to reconstruct 3D medical image volumes from a single x-ray image was shown in the present study. The network architecture was validated against the original scans presenting SSIM values of 0.77 ± 0.05 and 0.78 ± 0.06, respectively for the knee and the hip crop.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
2448-2457Subventions
Organisme : VLAIO
ID : HBC.2017.0397
Informations de copyright
© 2021 American Association of Physicists in Medicine.
Références
Ettinger M, Claassen L, Paes P, Calliess T. 2D versus 3D templating in total knee arthroplasty. Knee. 2016;23:149-151.
Grefenstette E, Blunsom P, de Freitas N, Hermann KM. A deep architecture for semantic parsing. arXiv preprint; 2014; arXiv:1404.7296. https://arxiv.org/abs/1404.7296
Wallach I, Dzamba M, Heifets A. AtomNet: a deep convolutional neural network for bioactivity prediction in structure-based drug discovery. arXiv preprint 2015;arXiv:1510.02855. https://arxiv.org/abs/1510.02855
Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst; 2012:1097-1105.
Gibson E, Giganti F, Hu Y, et al. Automatic multi-organ segmentation on abdominal CT with dense v-networks. IEEE Trans Med Imaging. 2018;37:1822-1834.
Astudillo P, De Beule M, Dambre J, et al. Towards safe and efficient preoperative planning of transcatheter mitral valve interventions. Morphologie. 2019l;103:139-147.
Firman M, Mac Aodha O, Julier S, Brostow GJ. Structured prediction of unobserved voxels from a single depth image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016;5431-5440.
Henzler P, Rasche V, Ropinski T, Ritschel T. Single-image tomography: 3D volumes from 2D cranial x-rays. Comput Graph Forum. 2018;37:377-388.
Shen L, Zhao W, Xing L. Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning. Nature Biomed Eng. 2019;3:880-888.
Kim H, Lee K, Lee D, Baek N. 3D Reconstruction of Leg Bones from X-Ray Images using CNN-based Feature Analysis. 2019 International Conference on Information and Communication Technology Convergence (ICTC); 2019:669-672.IEEE. https://doi.org/10.1109/ICTC46691.2019.8939984
Audenaert EA, Van Houcke J, Almeida DF, et al. Cascaded statistical shape model based segmentation of the full lower limb in CT. Comput Methods Biomech Biomed Eng. 2019;22:644-657.
World Health Organization: Baseline country survey on medical devices; 2011.
Sherouse GW, Novins K, Chaney EL. Computation of digitally reconstructed radiographs for use in radiotherapy treatment design. Int J Radiat Oncol Biol Phys. 1990;18:651-658.
Hyde DE, Habets DF, Fox AJ, et al. Comparison of maximum intensity projection and digitally reconstructed radiographic projection for carotid artery stenosis measurement. Med Phys. 2007;34:2968-2974.
Khamfongkhruea C, Thongsawad S, Tannanonta C, Chamchod S. Comparison of CT images with average intensity projection, free breathing, and mid-ventilation for dose calculation in lung cancer. J Appl Clin Med Phys. 2017;18:26-36.
Sharp GC, Li R, Wolfgang J, et al. Plastimatch-an open source software suite for radiotherapy image processing. In Proceedings of the XVI’th International Conference on the use of Computers in Radiotherapy (ICCR), Amsterdam, Netherlands; 2010.
Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint 2014;arXiv:1412.6980. https://arxiv.org/abs/1412.6980
Glorot X, Bengio Y. Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thirteenth international conference on artificial intelligence and statistics; 2010;249-256.
Maas AL, Hannun AY, Ng AY. Rectifier nonlinearities improve neural network acoustic models. Proc icml. 2013;30:3.
Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9:62-66.
Lorensen WE, Cline HE. Marching cubes: a high resolution 3D surface construction algorithm. ACM Siggraph Comput Graph. 1987;21:163-169.
Sethian JA. Level Set Methods and Fast Marching Methods. Cambridge: Cambridge University Press; 1996.
Mikołajczyk A, Grochowski M. Data augmentation for improving deep learning in image classification problem. 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinoujście; 2018: pp. 117-122. https://doi.org/10.1109/IIPHDW.2018.8388338
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 2004;13:600-612.
Almeida DF, Ruben RB, Folgado J, et al. Fully automatic segmentation of femurs with medullary canal definition in high and in low resolution CT scans. Med Eng Phys. 2016;38:1474-1480.
Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: learning dense volumetric segmentation from sparse annotation. International conference on medical image computing and computer-assisted intervention; 2016:424-432.Springer, Cham.
Hangartner TN. Correction of scatter in computed tomography images of bone. Med Phys. 1987;14:335-340.