Prediction of Acute Respiratory Failure Requiring Advanced Respiratory Support in Advance of Interventions and Treatment: A Multivariable Prediction Model From Electronic Medical Record Data.

acute respiratory failure data mining early warning scores electronic health records machine learning prediction

Journal

Critical care explorations
ISSN: 2639-8028
Titre abrégé: Crit Care Explor
Pays: United States
ID NLM: 101746347

Informations de publication

Date de publication:
May 2021
Historique:
entrez: 3 6 2021
pubmed: 4 6 2021
medline: 4 6 2021
Statut: epublish

Résumé

Acute respiratory failure occurs frequently in hospitalized patients and often begins outside the ICU, associated with increased length of stay, cost, and mortality. Delays in decompensation recognition are associated with worse outcomes. The objective of this study is to predict acute respiratory failure requiring any advanced respiratory support (including noninvasive ventilation). With the advent of the coronavirus disease pandemic, concern regarding acute respiratory failure has increased. All admission encounters from January 2014 to June 2017 from three hospitals in the Emory Healthcare network (82,699). External validation cohort: all admission encounters from January 2014 to June 2017 from a fourth hospital in the Emory Healthcare network (40,143). Temporal validation cohort: all admission encounters from February to April 2020 from four hospitals in the Emory Healthcare network coronavirus disease tested (2,564) and coronavirus disease positive (389). All admission encounters had vital signs, laboratory, and demographic data extracted. Exclusion criteria included invasive mechanical ventilation started within the operating room or advanced respiratory support within the first 8 hours of admission. Encounters were discretized into hour intervals from 8 hours after admission to discharge or advanced respiratory support initiation and binary labeled for advanced respiratory support. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment, our eXtreme Gradient Boosting-based algorithm, was compared against Modified Early Warning Score. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment had significantly better discrimination than Modified Early Warning Score (area under the receiver operating characteristic curve 0.85 vs 0.57 [test], 0.84 vs 0.61 [external validation]). Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment maintained a positive predictive value (0.31-0.21) similar to that of Modified Early Warning Score greater than 4 (0.29-0.25) while identifying 6.62 (validation) to 9.58 (test) times more true positives. Furthermore, Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment performed more effectively in temporal validation (area under the receiver operating characteristic curve 0.86 [coronavirus disease tested], 0.93 [coronavirus disease positive]), while achieving identifying 4.25-4.51× more true positives. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment is more effective than Modified Early Warning Score in predicting respiratory failure requiring advanced respiratory support at external validation and in coronavirus disease 2019 patients. Silent prospective validation necessary before local deployment.

Sections du résumé

BACKGROUND BACKGROUND
Acute respiratory failure occurs frequently in hospitalized patients and often begins outside the ICU, associated with increased length of stay, cost, and mortality. Delays in decompensation recognition are associated with worse outcomes.
OBJECTIVES OBJECTIVE
The objective of this study is to predict acute respiratory failure requiring any advanced respiratory support (including noninvasive ventilation). With the advent of the coronavirus disease pandemic, concern regarding acute respiratory failure has increased.
DERIVATION COHORT UNASSIGNED
All admission encounters from January 2014 to June 2017 from three hospitals in the Emory Healthcare network (82,699).
VALIDATION COHORT UNASSIGNED
External validation cohort: all admission encounters from January 2014 to June 2017 from a fourth hospital in the Emory Healthcare network (40,143). Temporal validation cohort: all admission encounters from February to April 2020 from four hospitals in the Emory Healthcare network coronavirus disease tested (2,564) and coronavirus disease positive (389).
PREDICTION MODEL UNASSIGNED
All admission encounters had vital signs, laboratory, and demographic data extracted. Exclusion criteria included invasive mechanical ventilation started within the operating room or advanced respiratory support within the first 8 hours of admission. Encounters were discretized into hour intervals from 8 hours after admission to discharge or advanced respiratory support initiation and binary labeled for advanced respiratory support. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment, our eXtreme Gradient Boosting-based algorithm, was compared against Modified Early Warning Score.
RESULTS RESULTS
Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment had significantly better discrimination than Modified Early Warning Score (area under the receiver operating characteristic curve 0.85 vs 0.57 [test], 0.84 vs 0.61 [external validation]). Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment maintained a positive predictive value (0.31-0.21) similar to that of Modified Early Warning Score greater than 4 (0.29-0.25) while identifying 6.62 (validation) to 9.58 (test) times more true positives. Furthermore, Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment performed more effectively in temporal validation (area under the receiver operating characteristic curve 0.86 [coronavirus disease tested], 0.93 [coronavirus disease positive]), while achieving identifying 4.25-4.51× more true positives.
CONCLUSIONS CONCLUSIONS
Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment is more effective than Modified Early Warning Score in predicting respiratory failure requiring advanced respiratory support at external validation and in coronavirus disease 2019 patients. Silent prospective validation necessary before local deployment.

Identifiants

pubmed: 34079945
doi: 10.1097/CCE.0000000000000402
pmc: PMC8162520
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e0402

Subventions

Organisme : NCATS NIH HHS
ID : KL2 TR002381
Pays : United States

Informations de copyright

Copyright © 2021 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of the Society of Critical Care Medicine.

Déclaration de conflit d'intérêts

Dr. Wong is supported by the National Institute of General Medical Sciences (NIGMS) 2T32GM095442 and the Clinical and Translational Science Award pilot informatics grant by National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) under UL1TR002378. He holds equity and management roles in Ataia Medical. Dr. Kamaleswaran is supported by the Michael J. Fox Foundation (Grant No. 17267). Dr. Reyna is supported by NIH U54EB027690 and HHS0100201900015C. Dr. Josef is supported by the NIGMS 2T32GM095442. Dr. Holder is supported by the NIGMS under award number K23GM137182 for Advancing Translational Sciences of the NIH under Award Number UL1TR002378. Dr. Nemati is supported by the NIH (No. K01ES025445) and the Gordon and Betty Moore Foundation (No. GBMF9052). Dr. Buchman is supported by the Society of Critical Care Medicine and the Biomedical Advanced Research and Development Authority. He is an Editor in Chief for Critical Care Medicine and has recused himself from editorial influence on this article. Dr. Blum is supported by the NCATS of the NIH under Award Number UL1TR002378. He is a consultant for Clew Medical. The remaining authors have disclosed that they do not have any potential conflicts of interest.

Références

QJM. 2001 Oct;94(10):521-6
pubmed: 11588210
J Biomed Inform. 2016 Dec;64:10-19
pubmed: 27658885
Resuscitation. 2018 Feb;123:86-91
pubmed: 29169912
Crit Care Med. 2017 Jan;45(1):75-84
pubmed: 27526267
JAMA. 2020 May 26;323(20):2052-2059
pubmed: 32320003
Crit Care. 2018 Oct 30;22(1):286
pubmed: 30373653
BMJ Open. 2016 Jun 10;6(6):e011347
pubmed: 27288382
Ann Intern Med. 2015 Jan 6;162(1):W1-73
pubmed: 25560730
Crit Care Med. 2020 Sep;48(9):e799-e804
pubmed: 32452888
Am J Respir Crit Care Med. 2015 Oct 15;192(8):958-64
pubmed: 26158402
J Clin Monit Comput. 2019 Aug;33(4):713-724
pubmed: 30264218
Crit Care Med. 2020 May;48(5):623-633
pubmed: 32141923
JAMA. 2020 Apr 28;323(16):1612-1614
pubmed: 32191259
PLoS Med. 2015 Oct 06;12(10):e1001885
pubmed: 26440803
Eur Heart J. 2014 Aug 1;35(29):1925-31
pubmed: 24898551
Chest. 2011 Dec;140(6):1447-1455
pubmed: 21998258
J Surg Res. 2018 Aug;228:179-187
pubmed: 29907209
Methods Inf Med. 2016 May 17;55(3):234-41
pubmed: 25925616
Crit Care Med. 2015 Oct;43(10):2059-65
pubmed: 26181217
N Engl J Med. 2020 May 21;382(21):2012-2022
pubmed: 32227758
Epidemiology. 2010 Jan;21(1):128-38
pubmed: 20010215

Auteurs

An-Kwok I Wong (AI)

Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, Emory University, Atlanta, GA.

Rishikesan Kamaleswaran (R)

Department of Biomedical Informatics, Emory University, Atlanta, GA.

Azade Tabaie (A)

Department of Biomedical Informatics, Emory University, Atlanta, GA.

Matthew A Reyna (MA)

Department of Biomedical Informatics, Emory University, Atlanta, GA.

Christopher Josef (C)

Department of Biomedical Informatics, Emory University, Atlanta, GA.

Chad Robichaux (C)

Department of Biomedical Informatics, Emory University, Atlanta, GA.

Anne A H de Hond (AAH)

Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, The Netherlands.
Department of Information Technology and Digital Innovation, Leiden University Medical Centre, Leiden, The Netherlands.

Ewout W Steyerberg (EW)

Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, The Netherlands.

Andre L Holder (AL)

Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, Emory University, Atlanta, GA.

Shamim Nemati (S)

Department of Biomedical Informatics, University of California San Diego, San Diego, CA.

Timothy G Buchman (TG)

Department of Surgery, Emory University, Atlanta, GA.

James M Blum (JM)

Department of Biomedical Informatics, Emory University, Atlanta, GA.
Department of Anesthesia, Emory University, Atlanta, GA.

Classifications MeSH