Machine learning does not improve upon traditional regression in predicting outcomes in atrial fibrillation: an analysis of the ORBIT-AF and GARFIELD-AF registries.
Atrial fibrillation
Machine learning
Outcomes
Journal
Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology
ISSN: 1532-2092
Titre abrégé: Europace
Pays: England
ID NLM: 100883649
Informations de publication
Date de publication:
01 11 2020
01 11 2020
Historique:
received:
03
01
2020
accepted:
26
05
2020
pubmed:
4
9
2020
medline:
29
6
2021
entrez:
4
9
2020
Statut:
ppublish
Résumé
Prediction models for outcomes in atrial fibrillation (AF) are used to guide treatment. While regression models have been the analytic standard for prediction modelling, machine learning (ML) has been promoted as a potentially superior methodology. We compared the performance of ML and regression models in predicting outcomes in AF patients. The Outcomes Registry for Better Informed Treatment of Atrial Fibrillation (ORBIT-AF) and Global Anticoagulant Registry in the FIELD (GARFIELD-AF) are population-based registries that include 74 792 AF patients. Models were generated from potential predictors using stepwise logistic regression (STEP), random forests (RF), gradient boosting (GB), and two neural networks (NNs). Discriminatory power was highest for death [STEP area under the curve (AUC) = 0.80 in ORBIT-AF, 0.75 in GARFIELD-AF] and lowest for stroke in all models (STEP AUC = 0.67 in ORBIT-AF, 0.66 in GARFIELD-AF). The discriminatory power of the ML models was similar or lower than the STEP models for most outcomes. The GB model had a higher AUC than STEP for death in GARFIELD-AF (0.76 vs. 0.75), but only nominally, and both performed similarly in ORBIT-AF. The multilayer NN had the lowest discriminatory power for all outcomes. The calibration of the STEP modelswere more aligned with the observed events for all outcomes. In the cross-registry models, the discriminatory power of the ML models was similar or lower than the STEP for most cases. When developed from two large, community-based AF registries, ML techniques did not improve prediction modelling of death, major bleeding, or stroke.
Identifiants
pubmed: 32879969
pii: 5900853
doi: 10.1093/europace/euaa172
pmc: PMC7657384
doi:
Substances chimiques
Anticoagulants
0
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1635-1644Subventions
Organisme : NHLBI NIH HHS
ID : T32 HL069749
Pays : United States
Organisme : NHLBI NIH HHS
ID : T32 HL079896
Pays : United States
Informations de copyright
Published on behalf of the European Society of Cardiology. All rights reserved. © The Author(s) 2020. For permissions, please email: journals.permissions@oup.com.
Références
Circ Res. 2017 Oct 13;121(9):1092-1101
pubmed: 28794054
Eur Heart J. 2015 Dec 7;36(46):3258-64
pubmed: 26424865
Am Heart J. 2017 Dec;194:132-140
pubmed: 29223431
Europace. 2016 Nov;18(11):1609-1678
pubmed: 27567465
Circ Cardiovasc Qual Outcomes. 2016 Nov;9(6):629-640
pubmed: 28263938
JAMA Cardiol. 2017 Feb 1;2(2):204-209
pubmed: 27784047
Biometrics. 1988 Sep;44(3):837-45
pubmed: 3203132
Eur Heart J. 2012 Jun;33(12):1500-10
pubmed: 22246443
Heart. 2018 Jul;104(14):1156-1164
pubmed: 29352006
BMJ Open. 2017 Dec 21;7(12):e017157
pubmed: 29273652
Am Heart J. 2012 Jan;163(1):13-19.e1
pubmed: 22172431
Stat Med. 2008 Jan 30;27(2):157-72; discussion 207-12
pubmed: 17569110
Nat Med. 2019 Jan;25(1):70-74
pubmed: 30617318
N Engl J Med. 2016 Sep 29;375(13):1216-9
pubmed: 27682033
JAMA Netw Open. 2019 Mar 1;2(3):e191095
pubmed: 30901052
Am Heart J. 2011 Oct;162(4):606-612.e1
pubmed: 21982650
PLoS One. 2017 Apr 4;12(4):e0174944
pubmed: 28376093
JAMA Intern Med. 2015 May;175(5):848-50
pubmed: 25730606
Am Heart J. 2014 Aug;168(2):160-7
pubmed: 25066554
Crit Care Med. 2016 Feb;44(2):368-74
pubmed: 26771782
J Thromb Haemost. 2005 Apr;3(4):692-4
pubmed: 15842354
J Am Coll Cardiol. 2014 Dec 2;64(21):e1-76
pubmed: 24685669