Machine learning does not improve upon traditional regression in predicting outcomes in atrial fibrillation: an analysis of the ORBIT-AF and GARFIELD-AF registries.


Journal

Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology
ISSN: 1532-2092
Titre abrégé: Europace
Pays: England
ID NLM: 100883649

Informations de publication

Date de publication:
01 11 2020
Historique:
received: 03 01 2020
accepted: 26 05 2020
pubmed: 4 9 2020
medline: 29 6 2021
entrez: 4 9 2020
Statut: ppublish

Résumé

Prediction models for outcomes in atrial fibrillation (AF) are used to guide treatment. While regression models have been the analytic standard for prediction modelling, machine learning (ML) has been promoted as a potentially superior methodology. We compared the performance of ML and regression models in predicting outcomes in AF patients. The Outcomes Registry for Better Informed Treatment of Atrial Fibrillation (ORBIT-AF) and Global Anticoagulant Registry in the FIELD (GARFIELD-AF) are population-based registries that include 74 792 AF patients. Models were generated from potential predictors using stepwise logistic regression (STEP), random forests (RF), gradient boosting (GB), and two neural networks (NNs). Discriminatory power was highest for death [STEP area under the curve (AUC) = 0.80 in ORBIT-AF, 0.75 in GARFIELD-AF] and lowest for stroke in all models (STEP AUC = 0.67 in ORBIT-AF, 0.66 in GARFIELD-AF). The discriminatory power of the ML models was similar or lower than the STEP models for most outcomes. The GB model had a higher AUC than STEP for death in GARFIELD-AF (0.76 vs. 0.75), but only nominally, and both performed similarly in ORBIT-AF. The multilayer NN had the lowest discriminatory power for all outcomes. The calibration of the STEP modelswere more aligned with the observed events for all outcomes. In the cross-registry models, the discriminatory power of the ML models was similar or lower than the STEP for most cases. When developed from two large, community-based AF registries, ML techniques did not improve prediction modelling of death, major bleeding, or stroke.

Identifiants

pubmed: 32879969
pii: 5900853
doi: 10.1093/europace/euaa172
pmc: PMC7657384
doi:

Substances chimiques

Anticoagulants 0

Types de publication

Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

1635-1644

Subventions

Organisme : NHLBI NIH HHS
ID : T32 HL069749
Pays : United States
Organisme : NHLBI NIH HHS
ID : T32 HL079896
Pays : United States

Informations de copyright

Published on behalf of the European Society of Cardiology. All rights reserved. © The Author(s) 2020. For permissions, please email: journals.permissions@oup.com.

Références

Circ Res. 2017 Oct 13;121(9):1092-1101
pubmed: 28794054
Eur Heart J. 2015 Dec 7;36(46):3258-64
pubmed: 26424865
Am Heart J. 2017 Dec;194:132-140
pubmed: 29223431
Europace. 2016 Nov;18(11):1609-1678
pubmed: 27567465
Circ Cardiovasc Qual Outcomes. 2016 Nov;9(6):629-640
pubmed: 28263938
JAMA Cardiol. 2017 Feb 1;2(2):204-209
pubmed: 27784047
Biometrics. 1988 Sep;44(3):837-45
pubmed: 3203132
Eur Heart J. 2012 Jun;33(12):1500-10
pubmed: 22246443
Heart. 2018 Jul;104(14):1156-1164
pubmed: 29352006
BMJ Open. 2017 Dec 21;7(12):e017157
pubmed: 29273652
Am Heart J. 2012 Jan;163(1):13-19.e1
pubmed: 22172431
Stat Med. 2008 Jan 30;27(2):157-72; discussion 207-12
pubmed: 17569110
Nat Med. 2019 Jan;25(1):70-74
pubmed: 30617318
N Engl J Med. 2016 Sep 29;375(13):1216-9
pubmed: 27682033
JAMA Netw Open. 2019 Mar 1;2(3):e191095
pubmed: 30901052
Am Heart J. 2011 Oct;162(4):606-612.e1
pubmed: 21982650
PLoS One. 2017 Apr 4;12(4):e0174944
pubmed: 28376093
JAMA Intern Med. 2015 May;175(5):848-50
pubmed: 25730606
Am Heart J. 2014 Aug;168(2):160-7
pubmed: 25066554
Crit Care Med. 2016 Feb;44(2):368-74
pubmed: 26771782
J Thromb Haemost. 2005 Apr;3(4):692-4
pubmed: 15842354
J Am Coll Cardiol. 2014 Dec 2;64(21):e1-76
pubmed: 24685669

Auteurs

Zak Loring (Z)

Duke Clinical Research Institute, Durham, NC, USA.
Division of Cardiology, Department of Medicine, Duke University Medical Center, 2301 Erwin Rd, DUMC 3845, Durham, NC 27710, USA.

Suchit Mehrotra (S)

Department of Statistics, North Carolina State University, Raleigh, NC, USA.

Jonathan P Piccini (JP)

Duke Clinical Research Institute, Durham, NC, USA.
Division of Cardiology, Department of Medicine, Duke University Medical Center, 2301 Erwin Rd, DUMC 3845, Durham, NC 27710, USA.

John Camm (J)

Cardiology Clinical Academic Group, St. George's University of London, London, UK.

David Carlson (D)

Duke Clinical Research Institute, Durham, NC, USA.

Gregg C Fonarow (GC)

Department of Medicine, UCLA Division of Cardiology, Los Angeles, CA, USA.

Keith A A Fox (KAA)

Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK.

Eric D Peterson (ED)

Duke Clinical Research Institute, Durham, NC, USA.
Division of Cardiology, Department of Medicine, Duke University Medical Center, 2301 Erwin Rd, DUMC 3845, Durham, NC 27710, USA.

Karen Pieper (K)

Duke Clinical Research Institute, Durham, NC, USA.

Ajay K Kakkar (AK)

Thrombosis Research Institute, London, UK.
University College London, London, UK.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH