Early Detection of Heart Failure With Reduced Ejection Fraction Using Perioperative Data Among Noncardiac Surgical Patients: A Machine-Learning Approach.
Journal
Anesthesia and analgesia
ISSN: 1526-7598
Titre abrégé: Anesth Analg
Pays: United States
ID NLM: 1310650
Informations de publication
Date de publication:
05 2020
05 2020
Historique:
entrez:
15
4
2020
pubmed:
15
4
2020
medline:
25
6
2020
Statut:
ppublish
Résumé
Heart failure with reduced ejection fraction (HFrEF) is a condition imposing significant health care burden. Given its syndromic nature and often insidious onset, the diagnosis may not be made until clinical manifestations prompt further evaluation. Detecting HFrEF in precursor stages could allow for early initiation of treatments to modify disease progression. Granular data collected during the perioperative period may represent an underutilized method for improving the diagnosis of HFrEF. We hypothesized that patients ultimately diagnosed with HFrEF following surgery can be identified via machine-learning approaches using pre- and intraoperative data. Perioperative data were reviewed from adult patients undergoing general anesthesia for major surgical procedures at an academic quaternary care center between 2010 and 2016. Patients with known HFrEF, heart failure with preserved ejection fraction, preoperative critical illness, or undergoing cardiac, cardiology, or electrophysiologic procedures were excluded. Patients were classified as healthy controls or undiagnosed HFrEF. Undiagnosed HFrEF was defined as lacking a HFrEF diagnosis preoperatively but establishing a diagnosis within 730 days postoperatively. Undiagnosed HFrEF patients were adjudicated by expert clinician review, excluding cases for which HFrEF was secondary to a perioperative triggering event, or any event not associated with HFrEF natural disease progression. Machine-learning models, including L1 regularized logistic regression, random forest, and extreme gradient boosting were developed to detect undiagnosed HFrEF, using perioperative data including 628 preoperative and 1195 intraoperative features. Training/validation and test datasets were used with parameter tuning. Test set model performance was evaluated using area under the receiver operating characteristic curve (AUROC), positive predictive value, and other standard metrics. Among 67,697 cases analyzed, 279 (0.41%) patients had undiagnosed HFrEF. The AUROC for the logistic regression model was 0.869 (95% confidence interval, 0.829-0.911), 0.872 (0.836-0.909) for the random forest model, and 0.873 (0.833-0.913) for the extreme gradient boosting model. The corresponding positive predictive values were 1.69% (1.06%-2.32%), 1.42% (0.85%-1.98%), and 1.78% (1.15%-2.40%), respectively. Machine-learning models leveraging perioperative data can detect undiagnosed HFrEF with good performance. However, the low prevalence of the disease results in a low positive predictive value, and for clinically meaningful sensitivity thresholds to be actionable, confirmatory testing with high specificity (eg, echocardiography or cardiac biomarkers) would be required following model detection. Future studies are necessary to externally validate algorithm performance at additional centers and explore the feasibility of embedding algorithms into the perioperative electronic health record for clinician use in real time.
Sections du résumé
BACKGROUND
Heart failure with reduced ejection fraction (HFrEF) is a condition imposing significant health care burden. Given its syndromic nature and often insidious onset, the diagnosis may not be made until clinical manifestations prompt further evaluation. Detecting HFrEF in precursor stages could allow for early initiation of treatments to modify disease progression. Granular data collected during the perioperative period may represent an underutilized method for improving the diagnosis of HFrEF. We hypothesized that patients ultimately diagnosed with HFrEF following surgery can be identified via machine-learning approaches using pre- and intraoperative data.
METHODS
Perioperative data were reviewed from adult patients undergoing general anesthesia for major surgical procedures at an academic quaternary care center between 2010 and 2016. Patients with known HFrEF, heart failure with preserved ejection fraction, preoperative critical illness, or undergoing cardiac, cardiology, or electrophysiologic procedures were excluded. Patients were classified as healthy controls or undiagnosed HFrEF. Undiagnosed HFrEF was defined as lacking a HFrEF diagnosis preoperatively but establishing a diagnosis within 730 days postoperatively. Undiagnosed HFrEF patients were adjudicated by expert clinician review, excluding cases for which HFrEF was secondary to a perioperative triggering event, or any event not associated with HFrEF natural disease progression. Machine-learning models, including L1 regularized logistic regression, random forest, and extreme gradient boosting were developed to detect undiagnosed HFrEF, using perioperative data including 628 preoperative and 1195 intraoperative features. Training/validation and test datasets were used with parameter tuning. Test set model performance was evaluated using area under the receiver operating characteristic curve (AUROC), positive predictive value, and other standard metrics.
RESULTS
Among 67,697 cases analyzed, 279 (0.41%) patients had undiagnosed HFrEF. The AUROC for the logistic regression model was 0.869 (95% confidence interval, 0.829-0.911), 0.872 (0.836-0.909) for the random forest model, and 0.873 (0.833-0.913) for the extreme gradient boosting model. The corresponding positive predictive values were 1.69% (1.06%-2.32%), 1.42% (0.85%-1.98%), and 1.78% (1.15%-2.40%), respectively.
CONCLUSIONS
Machine-learning models leveraging perioperative data can detect undiagnosed HFrEF with good performance. However, the low prevalence of the disease results in a low positive predictive value, and for clinically meaningful sensitivity thresholds to be actionable, confirmatory testing with high specificity (eg, echocardiography or cardiac biomarkers) would be required following model detection. Future studies are necessary to externally validate algorithm performance at additional centers and explore the feasibility of embedding algorithms into the perioperative electronic health record for clinician use in real time.
Identifiants
pubmed: 32287126
doi: 10.1213/ANE.0000000000004630
pii: 00000539-202005000-00012
pmc: PMC7467779
mid: NIHMS1620350
doi:
Types de publication
Journal Article
Observational Study
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
1188-1200Subventions
Organisme : NCATS NIH HHS
ID : KL2 TR002241
Pays : United States
Organisme : NHLBI NIH HHS
ID : K01 HL141701
Pays : United States
Organisme : NHLBI NIH HHS
ID : K01 HL136687
Pays : United States
Organisme : NCATS NIH HHS
ID : UL1 TR002240
Pays : United States
Organisme : NIGMS NIH HHS
ID : T32 GM103730
Pays : United States
Références
Nat Rev Cardiol. 2011 Jan;8(1):30-41
pubmed: 21060326
J Affect Disord. 2016 Mar 15;193:109-16
pubmed: 26773901
Prog Cardiovasc Dis. 2012 Nov-Dec;55(3):321-31
pubmed: 23217437
Circulation. 1999 Sep 7;100(10):1043-9
pubmed: 10477528
Circ Res. 2013 Aug 30;113(6):646-59
pubmed: 23989710
JAMA Cardiol. 2016 Dec 1;1(9):1014-1020
pubmed: 27706470
J Am Med Inform Assoc. 2017 Mar 1;24(2):361-370
pubmed: 27521897
Anesthesiology. 2016 Oct;125(4):656-66
pubmed: 27483124
Radiology. 2017 May;283(2):381-390
pubmed: 28092203
Anesth Analg. 2015 Nov;121(5):1231-9
pubmed: 26332856
Circ Cardiovasc Qual Outcomes. 2019 Oct;12(10):e005114
pubmed: 31610714
Circulation. 2017 Aug 8;136(6):e137-e161
pubmed: 28455343
J Med Syst. 2012 Oct;36(5):3353-73
pubmed: 22327386
Br J Anaesth. 2017 Jul 1;119(1):57-64
pubmed: 28974066
Bioinformatics. 2010 May 15;26(10):1340-7
pubmed: 20385727
N Engl J Med. 2002 Oct 31;347(18):1397-402
pubmed: 12409541
Am J Med. 2005 Oct;118(10):1134-41
pubmed: 16194645
Anesthesiology. 2017 Jun;126(6):1053-1063
pubmed: 28383323
J Clin Med. 2016 Jun 29;5(7):
pubmed: 27367736
J Am Med Inform Assoc. 2019 Dec 1;26(12):1466-1477
pubmed: 31314892
PLoS One. 2013;8(3):e59225
pubmed: 23555000
Anesthesiology. 2019 Jul;131(1):74-83
pubmed: 30998509
J Med Internet Res. 2016 Dec 16;18(12):e323
pubmed: 27986644
BMJ. 2016 Aug 09;354:i4098
pubmed: 27511067
JAMA. 2019 Feb 12;321(6):572-579
pubmed: 30747965
Conf Proc IEEE Eng Med Biol Soc. 2015;2015:2119-22
pubmed: 26736707
Circulation. 2012 Jan 3;125(1):188-97
pubmed: 22215894