Deep learning methods for automatic segmentation of lower leg muscles and bones from MRI scans of children with and without cerebral palsy.
Deep learning
MRI
cerebral palsy
lower leg
muscle segmentation
Journal
NMR in biomedicine
ISSN: 1099-1492
Titre abrégé: NMR Biomed
Pays: England
ID NLM: 8915233
Informations de publication
Date de publication:
12 2021
12 2021
Historique:
revised:
10
08
2021
received:
15
03
2021
accepted:
12
08
2021
pubmed:
22
9
2021
medline:
8
3
2022
entrez:
21
9
2021
Statut:
ppublish
Résumé
Cerebral palsy is a neurological condition that is known to affect muscle growth. Detailed investigations of muscle growth require segmentation of muscles from MRI scans, which is typically done manually. In this study, we evaluated the performance of 2D, 3D, and hybrid deep learning models for automatic segmentation of 11 lower leg muscles and two bones from MRI scans of children with and without cerebral palsy. All six models were trained and evaluated on manually segmented T
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e4609Informations de copyright
© 2021 John Wiley & Sons, Ltd.
Références
Positano V, Christiansen T, Santarelli MF, Ringgaard S, Landini L, Gastaldelli A. Accurate segmentation of subcutaneous and intermuscular adipose tissue from MR images of the thigh. J Magn Reson Imaging. 2009;29(3):677-684.
Sharma N, Aggarwal LM. Automated medical image segmentation techniques. J Med Phys. 2010;35(1):3-14.
Liu F, Zhou Z, Jang H, Samsonov A, Zhao G, Kijowski R. Deep convolutional neural network and 3D deformable approach for tissue segmentation in musculoskeletal magnetic resonance imaging. Magn Reson Med. 2018;79(4):2379-2391.
Feng F, Ashton-Miller JA, DeLancey JOL, Luo J. Convolutional neural network-based pelvic floor structure segmentation using magnetic resonance imaging in pelvic organ prolapse. Med Phys. 2020;47(9):4281-4293.
D'Souza A, Bolsterlee B, Lancaster A, Herbert RD. Muscle architecture in children with cerebral palsy and ankle contractures: an investigation using diffusion tensor imaging. Clin Biomech. 2019;68:205-211.
Handsfield GG, Meyer CH, Abel MF, Blemker SS. Heterogeneity of muscle sizes in the lower limbs of children with cerebral palsy. Muscle Nerve. 2016;53(6):933-945.
Barber L, Hastings-Ison T, Baker R, Barrett R, Lichtwark G. Medial gastrocnemius muscle volume and fascicle length in children aged 2 to 5 years with cerebral palsy. Dev Med Child Neurol. 2011;53(6):543-548.
Gilles B, Magnenat-Thalmann N. Musculoskeletal MRI segmentation using multi-resolution simplex meshes with medial representations. Med Image Anal. 2010;14(3):291-302.
Litjens G, Kooi T, Bejnordi BE, et al. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60-88.
Meijering E. A bird's-eye view of deep learning in bioimage analysis. Comput Struct Biotechnol J. 2020;18:2312-2325.
Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Martinez-Gonzalez P, Garcia-Rodriguez J. A survey on deep learning techniques for image and video semantic segmentation. Appl Soft Comput. 2018;70:41-65.
Khan A, Sohail A, Zahoora U, Qureshi AS. A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. 2020;53(8):5455-5516.
Falk T, Mai D, Bensch R, et al. U-net: deep learning for cell counting, detection, and morphometry. Nat Methods. 2019;16(1):67-70.
Buda M, Saha A, Mazurowski MA. Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm. Comput Biol Med. 2019;109:218-225.
Kemnitz J, Baumgartner CF, Eckstein F, et al. Clinical evaluation of fully automated thigh muscle and adipose tissue segmentation using a U-Net deep learning architecture in context of osteoarthritic knee pain. Magn Reson Mater Phys Biol Med. 2020;33(4):483-493.
Hiasa Y, Otake Y, Takao M, Ogawa T, Sugano N, Sato Y. Automated muscle segmentation from clinical CT using Bayesian U-Net for personalized musculoskeletal modeling. IEEE Trans Med Imaging. 2019;39(4):1030-1040.
Froeling M, Schlaffke L, Rohm M, Isgum I, Kan HE & Wolterink JM Evaluation of input data and UNet based convolutional network architectures for automated muscle annotation in 2D and 3D. In: ISMRM 27th Annual Meeting & Exhibition; 2019.
Çiçek O, Abdulkadir A, Lienkamp SS, Brox T & Ronneberger O 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI) S. Ourselin, L. Joskowicz, M. Sabuncu, G. Unal, W. Wells, eds. Springer; 2016; Cham:424-432.
Qamar S, Jin H, Zheng R, Ahmad P, Usama M. A variant form of 3D-UNet for infant brain segmentation. Future Gener Comput Syst. 2020;108:613-623.
Milletari F, Navab N, Ahmadi S-A. V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: IEEE International Conference on 3D Vision. IEEE Computer Society; 2016:565-571.
Li X, Chen H, Qi X, Dou Q, Fu C, Heng P. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018;37(12):2663-2674.
Ni R, Meyer CH, Blemker SS, Hart JM, Feng X. Automatic segmentation of all lower limb muscles from high-resolution magnetic resonance imaging using a cascaded three-dimensional deep convolutional neural network. J Med Imaging. 2019;6(4):44009.
Guo Z, Zhang H, Chen Z, et al. Fully automated 3D segmentation of MR-imaged calf muscle compartments: neighborhood relationship enhanced fully convolutional network. Comput Med Imaging Graph. 2021;87:101835.
Shen H, Wang R, Zhang J, McKenna SJ. Boundary-aware fully convolutional network for brain tumor segmentation. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins DL, Duchesne S, eds. Medical Image Computing and Computer-Assisted Intervention (MICCAI). Cham: Springer; 2017:433-441.
Isensee F, Jaeger. PF, Kohl SAA, Petersen J, Maier-Hein KH. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat Methods. 2021;18(2):203-211.
Herbert R, Bolsterlee B & Chow B et al. Muscle growth in the lower extremity: the MUGgLE study. https://doi.org/10.17605/OSF.IO/SCFXJ, https://osf.io/scfxj; 2019.
Ackerman MJ. The Visible Human Project. Proc IEEE. 1998;86(3):504-511.
Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging. 2020;39(6):1856-1867.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society; 2016; Los Alamitos, CA:770-778.
Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning Bach F, Blei D, eds., Proceedings of Machine Learning Research, vol. 37. PMLR; 2015; Lille, France:448-456.
Huang G, Liu Z, Maaten LVD, Weinberger KQ. Densely connected convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society; 2017; Los Alamitos, CA:2261-2269.
Deng J, Dong W, Socher R, Li L, Li K, Fei-Fei L. ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops). IEEE Computer Society; 2009; Los Alamitos, CA:248-255.
Raghu M, Zhang C, Kleinberg J, Bengio S. Transfusion: understanding transfer learning for medical imaging. In: Wallach H, Larochelle H, Beygelzimer A, d'Alché-Buc F, Fox E, Garnett R, eds. Advances in Neural Information Processing Systems, Vol. 32: Curran; 2019:3347-3357.
Zhao H, Chen Z. A simple hole filling algorithm for binary cell images. In: Galkowski K, Kim Y-H, eds. Advances in mechatronics and control engineering II, Applied Mechanics and Materials, vol. 433: Trans Tech; 2013:1715-1719.
Loshchilov I, Hutter F. Decoupled weight decay regularization. In: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA. OpenReview.net; 2019.
Kim H, Jung J, Kim J, et al. Abdominal multi-organ auto-segmentation using 3D-patch-based deep convolutional neural network. Sci Rep. 2020;10(1):6204.
Ulyanov D, Vedaldi A, Lempitsky V. Instance normalization: the missing ingredient for fast stylization; 2017.
Zhang Z, Sabuncu M. Generalized cross entropy loss for training deep neural networks with noisy labels. In: Bengio S, Wallach H, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R, eds. Advances in Neural Information Processing Systems, Vol. 31: Curran; 2018:8778-8788.
Lei T, Wang R, Wan Y, Du X, Meng H, Nandi AK. Medical image segmentation using deep learning: a survey. arXiv; 2020.
Ma J, Chen J, Ng M, et al. Loss odyssey in medical image segmentation. Med Image Anal. 2021;71:102035.
Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Martinez-Gonzalez P, Garcia-Rodriguez J. A survey on deep learning techniques for image and video semantic segmentation. Appl Soft Comput. 2018;70:41-65.
Aldoj N, Biavati F, Michallek F, Stober S, Dewey M. Automatic prostate and prostate zones segmentation of magnetic resonance images using DenseNet-like U-net. Sci Rep. 2020;10(1):14315.
Narayana PA, Coronado I, Sujit SJ, Wolinsky JS, Lublin FD, Gabr RE. Deep-learning-based neural tissue segmentation of MRI in multiple sclerosis: effect of training set size. J Magn Reson Imaging. 2020;51(5):1487-1496.
Figueroa RL, Zeng-Treitler Q, Kandula S, Ngo LH. Predicting sample size required for classification performance. BMC Med Inform Decis Mak. 2012;12(1):8.
Lin T-Y, Goyal P, Girshick R, He K, Dollr P. Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell. 2020;42(2):318-327.
Abraham N, Khan NM. A novel focal Tversky loss function with improved attention U-Net for lesion segmentation. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE; 2019:683-687.
Bertels J, Eelbode T, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB. Optimizing the Dice score and Jaccard index for medical image segmentation: theory and practice. In: International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI). Springer; 2019; Cham:92-100.
Gibson E, Li W, Sudre C, et al. NiftyNet: a deep-learning platform for medical imaging. Comput Methods Programs Biomed. 2018;158:113-122.
Dolz J, Desrosiers C, Wang L, Yuan J, Shen D, Ben Ayed I. Deep CNN ensembles and suggestive annotations for infant brain MRI segmentation. Comput Med Imaging Graph. 2020;79:101660.
Jia H, Xia Y, Song Y, Zhang D, Huang H, Zhang Y, Cai W. 3D APA-Net: 3D adversarial pyramid anisotropic convolutional network for prostate segmentation in MR images. IEEE Trans Med Imaging. 2020;39(2):447-457.