Are All Deep Learning Architectures Alike for Point-of-Care Ultrasound?: Evidence From a Cardiac Image Classification Model Suggests Otherwise.


Journal

Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine
ISSN: 1550-9613
Titre abrégé: J Ultrasound Med
Pays: England
ID NLM: 8211547

Informations de publication

Date de publication:
Jun 2020
Historique:
received: 14 11 2019
revised: 05 12 2019
accepted: 08 12 2019
pubmed: 25 12 2019
medline: 23 3 2021
entrez: 25 12 2019
Statut: ppublish

Résumé

Little is known about optimal deep learning (DL) approaches for point-of-care ultrasound (POCUS) applications. We compared 6 popular DL architectures for POCUS cardiac image classification to determine whether an optimal DL architecture exists for future DL algorithm development in POCUS. We trained 6 convolutional neural networks (CNNs) with a range of complexities and ages (AlexNet, VGG-16, VGG-19, ResNet50, DenseNet201, and Inception-v4). Each CNN was trained by using images of 5 typical POCUS cardiac views. Images were extracted from 225 publicly available deidentified POCUS cardiac videos. A total of 750,018 individual images were extracted, with 90% used for model training and 10% for cross-validation. The training time and accuracy achieved were tracked. A real-world test of the algorithms was performed on a set of 125 completely new cardiac images. Descriptive statistics, Pearson R values, and κ values were calculated for each CNN. Accuracy ranged from 96% to 85.6% correct for the 6 CNNs. VGG-16, one of the oldest and simplest CNNs, performed best at 96% correct with 232 minutes to train (R = 0.97; κ = 0.95; P < .00001). The worst-performing CNN was the newer DenseNet201, with 85.6% accuracy and 429 minutes to train (R = 0.92; κ = 0.82; P < .00001). Six common image classification DL algorithms showed considerable variability in their accuracy and training time when trained and tested on identical data, suggesting that not all will perform optimally for POCUS DL applications. Contrary to well-established accuracies for CNNs, more modern and deeper algorithms yielded poorer results.

Identifiants

pubmed: 31872477
doi: 10.1002/jum.15206
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

1187-1194

Informations de copyright

© 2019 by the American Institute of Ultrasound in Medicine.

Références

Chilamkurthy S, Ghosh R, Tanamala S, et al. Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet 2018; 392:2388-2396.
Singh R, Kalra MK, Nitiwarangkul C, et al. Deep learning in chest radiography: detection of findings and presence of change. PLoS One 2018; 13:e0204155.
Cha MJ, Chung MJ, Lee JH, Lee KS. Performance of deep learning model in detecting operable lung cancer with chest radiographs. J Thorac Imaging 2019; 34:86-91.
Abiyev RH, Ma'aitah MKS. Deep convolutional neural networks for chest diseases detection. J Healthc Eng 2018; 2018:4168538.
Kim DH, MacKinnon T. Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. Clin Radiol 2018; 73:439-445.
Byra M, Styczynski G, Szmigielski C, et al. Transfer learning with deep convolutional neural network for liver steatosis assessment in ultrasound images. Int J Comput Assist Radiol Surg 2018; 13:1895-1903.
Xu Y, Wang Y, Yuan J, Cheng Q, Wang X, Carson PL. Medical breast ultrasound image segmentation by machine learning. Ultrasonics 2019; 91:1-9.
Bornemann P, Barreto T. Point-of-care ultrasonography in family medicine. Am Fam Physician 2018; 98:200-202.
Soni NJ, Schnobrich D, Mathews BK, et al. Point-of-Care ultrasound for hospitalists: a position statement of the Society of Hospital Medicine. J Hosp Med 2019; 14:E1-E6.
Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions. arXiv website; 2014. https://arxiv.org/pdf/1409.4842v1.pdf.
Chablani M. DenseNet. Towards Data Science website; 2017. https://towardsdatascience.com/densenet-2810936aeebb.
ImageNet website; 2016. http://image-net.org.
Blaivas M, Arntfield RT, White M. DIY AI: deep learning algorithm for ultrasound video analyses and classification [abstract]. Ann Emerg Med 2019; 74(suppl):S135.
Kornblith S, Shlens J, Le Q. Do better ImageNet models transfer better? Computer Vision Foundation website; 2019. http://openaccess.thecvf.com/content_CVPR_2019/papers/Kornblith_Do_Better_ImageNet_Models_Transfer_Better_CVPR_2019_paper.pdf.
Kim DW, Jang HY, Kim KW, Shin Y, Park SH. Design characteristics of studies reporting the performance of artificial intelligence algorithms for diagnostic analysis of medical images: results from recently published papers. Korean J Radiol 2019; 20:405-410.
Pardamean B, Cenggoro T, Rahutomo R, Budiarto A, Karappiah E. Transfer learning from chest x-ray pre-trained convolutional neural network for learning mammogram data. Proc Comput Sci 2018; 135:400-407.
Russakovsky O, Deng J, Su H, et al. ImageNet large scale visual recognition challenge. Int J Comput Vision 2015; 115:211-252.
Saikia AR, Bora K, Mahanta LB, Das AK. Comparative assessment of CNN architectures for classification of breast FNAC images. Tissue Cell 2019; 57:8-14.
Ko SY, Lee JH, Yoon JH, et al. Deep convolutional neural network for the diagnosis of thyroid nodules on ultrasound. Head Neck 2019; 41:885-891.

Auteurs

Michael Blaivas (M)

University of South Carolina School of Medicine, Columbia, South Carolina, USA.
Department of Emergency Medicine, St Francis Hospital, Columbus, Georgia, USA.

Laura Blaivas (L)

Michigan State University, East Lansing, Michigan, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH