Simple models vs. deep learning in detecting low ejection fraction from the electrocardiogram.

Artificial intelligence Deep learning Electrocardiograms Explainability Interpretability

Journal

European heart journal. Digital health
ISSN: 2634-3916
Titre abrégé: Eur Heart J Digit Health
Pays: England
ID NLM: 101778323

Informations de publication

Date de publication:
Jul 2024
Historique:
received: 14 02 2024
revised: 28 03 2024
accepted: 23 04 2024
medline: 31 7 2024
pubmed: 31 7 2024
entrez: 31 7 2024
Statut: epublish

Résumé

Deep learning methods have recently gained success in detecting left ventricular systolic dysfunction (LVSD) from electrocardiogram (ECG) waveforms. Despite their high level of accuracy, they are difficult to interpret and deploy broadly in the clinical setting. In this study, we set out to determine whether simpler models based on standard ECG measurements could detect LVSD with similar accuracy to that of deep learning models. Using an observational data set of 40 994 matched 12-lead ECGs and transthoracic echocardiograms, we trained a range of models with increasing complexity to detect LVSD based on ECG waveforms and derived measurements. The training data were acquired from the Stanford University Medical Center. External validation data were acquired from the Columbia Medical Center and the UK Biobank. The Stanford data set consisted of 40 994 matched ECGs and echocardiograms, of which 9.72% had LVSD. A random forest model using 555 discrete, automated measurements achieved an area under the receiver operator characteristic curve (AUC) of 0.92 (0.91-0.93), similar to a deep learning waveform model with an AUC of 0.94 (0.93-0.94). A logistic regression model based on five measurements achieved high performance [AUC of 0.86 (0.85-0.87)], close to a deep learning model and better than N-terminal prohormone brain natriuretic peptide (NT-proBNP). Finally, we found that simpler models were more portable across sites, with experiments at two independent, external sites. Our study demonstrates the value of simple electrocardiographic models that perform nearly as well as deep learning models, while being much easier to implement and interpret.

Identifiants

pubmed: 39081946
doi: 10.1093/ehjdh/ztae034
pii: ztae034
pmc: PMC11284011
doi:

Types de publication

Journal Article

Langues

eng

Pagination

427-434

Informations de copyright

© The Author(s) 2024. Published by Oxford University Press on behalf of the European Society of Cardiology.

Déclaration de conflit d'intérêts

Conflict of interest: E.A. reports consulting fees from Apple Inc. M.V.P. reports research funding from NIH/NHLBI and Apple Inc., consulting fees from Apple Inc., Boston Scientific, Biotronik Inc., Bristol Myers Squibb, QALY, Johnson & Johnson, and has an equity interest in QALY.

Auteurs

John Weston Hughes (JW)

Department of Computer Science, Stanford University, 353 Jane Stanford Way, Stanford, CA 94305, USA.

Sulaiman Somani (S)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

Pierre Elias (P)

Department of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.

James Tooley (J)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

Albert J Rogers (AJ)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

Timothy Poterucha (T)

Department of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.

Christopher M Haggerty (CM)

Department of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.

Michael Salerno (M)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

David Ouyang (D)

Cedars-Sinai Medical Center, Department of Cardiology, Smidt Heart Institute, 127 S San Vicente Blvd Pavilion, Suite A3600, Los Angeles, CA 90048, USA.

Euan Ashley (E)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

James Zou (J)

Department of Biomedical Data Science, Stanford University, 1265 Welch Road, Stanford, CA 94305, USA.

Marco V Perez (MV)

Department of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

Classifications MeSH