Echocardiographic Detection of Regional Wall Motion Abnormalities using Artificial Intelligence Compared to Human Readers.

coronary artery disease deep learning echocardiography machine learning ventricular function

Journal

Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography
ISSN: 1097-6795
Titre abrégé: J Am Soc Echocardiogr
Pays: United States
ID NLM: 8801388

Informations de publication

Date de publication:
29 Mar 2024
Historique:
received: 08 03 2024
accepted: 25 03 2024
medline: 1 4 2024
pubmed: 1 4 2024
entrez: 31 3 2024
Statut: aheadofprint

Résumé

Although regional wall motion abnormality (RWMA) detection is foundational to transthoracic echocardiography (TTE), current methods are prone to inter-observer variability. We aimed to develop a deep learning (DL) model for RWMA assessment and compare it to expert and novice readers. We used 15,746 TTE studies-including 25,529 apical videos-which were split into training, validation, and test datasets. A convolutional neural network was trained and validated using apical 2-, 3-, and 4-chamber videos to predict the presence of RWMA in 7 regions defined by coronary perfusion territories, using the ground truth derived from clinical TTE reports. Within the test cohort, DL model accuracy was compared to 6 expert and 3 novice readers using F1 score evaluation, with the ground truth of RWMA defined by expert readers. Significance between the DL model and novices was assessed using the permutation test. Within the test cohort, the DL model accurately identified any RWMA with AUC 0.96 (0.92-0.98). The mean F1 scores of the experts and the DL model were numerically similar for 6/7 regions: anterior (86 vs 84), anterolateral (80 vs 74), inferolateral (83 vs 87), inferoseptal (86 vs 86), apical (88 vs 87), inferior (79 vs 81), and any RWMA (90 vs 94 respectively), while in the anteroseptal region F1 score of the DL model was lower than the experts (75 vs 89). Using F1 scores, the DL model outperformed both novices 1 (p=0.002) and 2 (p=0.02) for the detection of any RWMA. DL provides accurate detection of RWMA which was comparable to experts and outperformed a majority of novices. DL may improve the efficiency of RWMA assessment and serve as a teaching tool for novices.

Sections du résumé

BACKGROUND BACKGROUND
Although regional wall motion abnormality (RWMA) detection is foundational to transthoracic echocardiography (TTE), current methods are prone to inter-observer variability. We aimed to develop a deep learning (DL) model for RWMA assessment and compare it to expert and novice readers.
METHODS METHODS
We used 15,746 TTE studies-including 25,529 apical videos-which were split into training, validation, and test datasets. A convolutional neural network was trained and validated using apical 2-, 3-, and 4-chamber videos to predict the presence of RWMA in 7 regions defined by coronary perfusion territories, using the ground truth derived from clinical TTE reports. Within the test cohort, DL model accuracy was compared to 6 expert and 3 novice readers using F1 score evaluation, with the ground truth of RWMA defined by expert readers. Significance between the DL model and novices was assessed using the permutation test.
RESULTS RESULTS
Within the test cohort, the DL model accurately identified any RWMA with AUC 0.96 (0.92-0.98). The mean F1 scores of the experts and the DL model were numerically similar for 6/7 regions: anterior (86 vs 84), anterolateral (80 vs 74), inferolateral (83 vs 87), inferoseptal (86 vs 86), apical (88 vs 87), inferior (79 vs 81), and any RWMA (90 vs 94 respectively), while in the anteroseptal region F1 score of the DL model was lower than the experts (75 vs 89). Using F1 scores, the DL model outperformed both novices 1 (p=0.002) and 2 (p=0.02) for the detection of any RWMA.
CONCLUSIONS CONCLUSIONS
DL provides accurate detection of RWMA which was comparable to experts and outperformed a majority of novices. DL may improve the efficiency of RWMA assessment and serve as a teaching tool for novices.

Identifiants

pubmed: 38556038
pii: S0894-7317(24)00163-9
doi: 10.1016/j.echo.2024.03.017
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Informations de copyright

Copyright © 2024. Published by Elsevier Inc.

Auteurs

Jeremy A Slivnick (JA)

University of Chicago Medical Center, Chicago, IL.

Nils T Gessert (NT)

Philips Healthcare, Cambridge, MA.

Juan I Cotella (JI)

University of Chicago Medical Center, Chicago, IL.

Lucas Oliveira (L)

Philips Healthcare, Cambridge, MA.

Nicola Pezzotti (N)

Philips Healthcare, Cambridge, MA.

Parastou Eslami (P)

Philips Healthcare, Cambridge, MA.

Ali Sadeghi (A)

Philips Healthcare, Cambridge, MA.

Simon Wehle (S)

Philips Healthcare, Cambridge, MA.

David Prabhu (D)

Philips Healthcare, Cambridge, MA.

Irina Waechter-Stehle (I)

Philips Healthcare, Cambridge, MA.

Ashish M Chaudhari (AM)

Philips Healthcare, Cambridge, MA.

Teodora Szasz (T)

Philips Healthcare, Cambridge, MA.

Linda Lee (L)

University of Chicago Medical Center, Chicago, IL.

Marie Altenburg (M)

University of Chicago Medical Center, Chicago, IL.

Giancarlo Saldana (G)

University of Chicago Medical Center, Chicago, IL.

Michael Randazzo (M)

University of Chicago Medical Center, Chicago, IL.

Jeanne M DeCara (JM)

University of Chicago Medical Center, Chicago, IL.

Karima Addetia (K)

University of Chicago Medical Center, Chicago, IL.

Victor Mor-Avi (V)

University of Chicago Medical Center, Chicago, IL.

Roberto M Lang (RM)

University of Chicago Medical Center, Chicago, IL. Electronic address: rlang@medicine.bsd.uchicago.edu.

Classifications MeSH