Echocardiographic Detection of Regional Wall Motion Abnormalities using Artificial Intelligence Compared to Human Readers.
coronary artery disease
deep learning
echocardiography
machine learning
ventricular function
Journal
Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography
ISSN: 1097-6795
Titre abrégé: J Am Soc Echocardiogr
Pays: United States
ID NLM: 8801388
Informations de publication
Date de publication:
29 Mar 2024
29 Mar 2024
Historique:
received:
08
03
2024
accepted:
25
03
2024
medline:
1
4
2024
pubmed:
1
4
2024
entrez:
31
3
2024
Statut:
aheadofprint
Résumé
Although regional wall motion abnormality (RWMA) detection is foundational to transthoracic echocardiography (TTE), current methods are prone to inter-observer variability. We aimed to develop a deep learning (DL) model for RWMA assessment and compare it to expert and novice readers. We used 15,746 TTE studies-including 25,529 apical videos-which were split into training, validation, and test datasets. A convolutional neural network was trained and validated using apical 2-, 3-, and 4-chamber videos to predict the presence of RWMA in 7 regions defined by coronary perfusion territories, using the ground truth derived from clinical TTE reports. Within the test cohort, DL model accuracy was compared to 6 expert and 3 novice readers using F1 score evaluation, with the ground truth of RWMA defined by expert readers. Significance between the DL model and novices was assessed using the permutation test. Within the test cohort, the DL model accurately identified any RWMA with AUC 0.96 (0.92-0.98). The mean F1 scores of the experts and the DL model were numerically similar for 6/7 regions: anterior (86 vs 84), anterolateral (80 vs 74), inferolateral (83 vs 87), inferoseptal (86 vs 86), apical (88 vs 87), inferior (79 vs 81), and any RWMA (90 vs 94 respectively), while in the anteroseptal region F1 score of the DL model was lower than the experts (75 vs 89). Using F1 scores, the DL model outperformed both novices 1 (p=0.002) and 2 (p=0.02) for the detection of any RWMA. DL provides accurate detection of RWMA which was comparable to experts and outperformed a majority of novices. DL may improve the efficiency of RWMA assessment and serve as a teaching tool for novices.
Sections du résumé
BACKGROUND
BACKGROUND
Although regional wall motion abnormality (RWMA) detection is foundational to transthoracic echocardiography (TTE), current methods are prone to inter-observer variability. We aimed to develop a deep learning (DL) model for RWMA assessment and compare it to expert and novice readers.
METHODS
METHODS
We used 15,746 TTE studies-including 25,529 apical videos-which were split into training, validation, and test datasets. A convolutional neural network was trained and validated using apical 2-, 3-, and 4-chamber videos to predict the presence of RWMA in 7 regions defined by coronary perfusion territories, using the ground truth derived from clinical TTE reports. Within the test cohort, DL model accuracy was compared to 6 expert and 3 novice readers using F1 score evaluation, with the ground truth of RWMA defined by expert readers. Significance between the DL model and novices was assessed using the permutation test.
RESULTS
RESULTS
Within the test cohort, the DL model accurately identified any RWMA with AUC 0.96 (0.92-0.98). The mean F1 scores of the experts and the DL model were numerically similar for 6/7 regions: anterior (86 vs 84), anterolateral (80 vs 74), inferolateral (83 vs 87), inferoseptal (86 vs 86), apical (88 vs 87), inferior (79 vs 81), and any RWMA (90 vs 94 respectively), while in the anteroseptal region F1 score of the DL model was lower than the experts (75 vs 89). Using F1 scores, the DL model outperformed both novices 1 (p=0.002) and 2 (p=0.02) for the detection of any RWMA.
CONCLUSIONS
CONCLUSIONS
DL provides accurate detection of RWMA which was comparable to experts and outperformed a majority of novices. DL may improve the efficiency of RWMA assessment and serve as a teaching tool for novices.
Identifiants
pubmed: 38556038
pii: S0894-7317(24)00163-9
doi: 10.1016/j.echo.2024.03.017
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
Copyright © 2024. Published by Elsevier Inc.