Automated Identification of Heart Failure With Reduced Ejection Fraction Using Deep Learning-Based Natural Language Processing.

BACKGROUND

The lack of automated tools for measuring care quality limits the implementation of a national program to assess guideline-directed care in heart failure with reduced ejection fraction (HFrEF).

OBJECTIVES

The authors aimed to automate the identification of patients with HFrEF at hospital discharge, an opportunity to evaluate and improve the quality of care.

METHODS

The authors developed a novel deep-learning language model for identifying patients with HFrEF from discharge summaries of hospitalizations with heart failure at Yale New Haven Hospital during 2015 to 2019. HFrEF was defined by left ventricular ejection fraction <40% on antecedent echocardiography. The authors externally validated the model at Northwestern Medicine, community hospitals of Yale, and the MIMIC-III (Medical Information Mart for Intensive Care III) database.

RESULTS

A total of 13,251 notes from 5,392 unique individuals (age 73 ± 14 years, 48% women), including 2,487 patients with HFrEF (46.1%), were used for model development (train/held-out: 70%/30%). The model achieved an area under receiver-operating characteristic curve (AUROC) of 0.97 and area under precision recall curve (AUPRC) of 0.97 in detecting HFrEF on the held-out set. The model had high performance in identifying HFrEF with AUROC = 0.94 and AUPRC = 0.91 on 19,242 notes from Northwestern Medicine, AUROC = 0.95 and AUPRC = 0.96 on 139 manually abstracted notes from Yale community hospitals, and AUROC = 0.91 and AUPRC = 0.92 on 146 manually reviewed notes from MIMIC-III. Model-based predictions of HFrEF corresponded to a net reclassification improvement of 60.2 ± 1.9% compared with diagnosis codes (P < 0.001).

CONCLUSIONS

The authors developed a language model that identifies HFrEF from clinical notes with high precision and accuracy, representing a key element in automating quality assessment for individuals with HFrEF.

Informations de copyright

Copyright © 2024. Published by Elsevier Inc.

Déclaration de conflit d'intérêts

Funding Support and Author Disclosures This study was supported by research funding awarded to Dr Khera by the Yale School of Medicine and grant support from the National Heart, Lung, and Blood Institute (NHLBI) of the National Institutes of Health (NIH) under the award K23HL153775. Dr Ahmad is a consultant for Sanofi Aventis, Amgen, and Cytokinetics; and has received research funding from Boehringer Ingelheim, AstraZeneca, Cytokinetics, and Relypsa. Dr Nadkarni has consultancy agreements with AstraZeneca, BioVie, GLG Consulting, Pensieve Health, Reata, Renalytix, Siemens Healthineers and Variant Bio; has received research funding from Goldfinch Bio, and Renalytix; has received honoraria from AstraZeneca, BioVie, Lexicon, Daiichi Sankyo, Meanrini Health, and Reata; has patents or royalties with Renalytix; owns equity and stock options in Pensieve Health and Renalytix as a scientific cofounder; owns equity in Verici Dx; has received financial compensation as a scientific board member and advisor to Renalytix; has served on the advisory board of Neurona Health; and has served in an advisory or leadership role for Pensieve Health and Renalytix. Dr Ahmad has received grants from the Agency for Healthcare Research and Quality, NIH/NHLBI, and American Heart Association; and has received personal fees from Teladoc, Livongo, and Pfizer, outside of the submitted work. Dr Krumholz works under contract with the Centers for Medicare and Medicaid Services to support quality measurement programs; was a recipient of a research grant from Johnson and Johnson, through Yale University, to support clinical trial data sharing; was a recipient of a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; receives payment from the Arnold and Porter Law Firm for work related to the Sanofi clopidogrel litigation, from the Martin Baughman Law Firm for work related to the Cook Celect IVC filter litigation, and from the Siegfried and Jensen Law Firm for work related to Vioxx litigation; chairs a Cardiac Scientific Advisory Board for UnitedHealth; was a member of the IBM Watson Health Life Sciences Board; is a member of the Advisory Board for Element Science, the Advisory Board for Facebook, and the Physician Advisory Board for Aetna; and is the cofounder of Hugo Health, a personal health information platform, and cofounder of Refactor Health, a health care AI-augmented data management company. Dr Khera is an Associate Editor of JAMA; receives support from the NHLBI of the NIH (under awards R01HL167858 and K23HL153775) and the Doris Duke Charitable Foundation (under award 2022060); has received research support, through Yale, from Bristol Myers Squibb, Novo Nordisk, and BridgeBio; is a coinventor of U.S. Pending Patent Applications 63/562,335, 63/177,117, 63/428,569, 63/346,610, 63/484,426, 63/508,315, and 63/606,203; and is a co-founder of Ensight-AI, Inc and Evidence2Health, health platforms to improve cardiovascular diagnosis and evidence-based cardiovascular care. Dr Nargesi has received funding from the NHLBI under award number T32HL007604. All other authors have reported that they have no relationships relevant to the contents of this paper to disclose.