Prediction of Acute Respiratory Failure Requiring Advanced Respiratory Support in Advance of Interventions and Treatment: A Multivariable Prediction Model From Electronic Medical Record Data.
acute respiratory failure
data mining
early warning scores
electronic health records
machine learning
prediction
Journal
Critical care explorations
ISSN: 2639-8028
Titre abrégé: Crit Care Explor
Pays: United States
ID NLM: 101746347
Informations de publication
Date de publication:
May 2021
May 2021
Historique:
entrez:
3
6
2021
pubmed:
4
6
2021
medline:
4
6
2021
Statut:
epublish
Résumé
Acute respiratory failure occurs frequently in hospitalized patients and often begins outside the ICU, associated with increased length of stay, cost, and mortality. Delays in decompensation recognition are associated with worse outcomes. The objective of this study is to predict acute respiratory failure requiring any advanced respiratory support (including noninvasive ventilation). With the advent of the coronavirus disease pandemic, concern regarding acute respiratory failure has increased. All admission encounters from January 2014 to June 2017 from three hospitals in the Emory Healthcare network (82,699). External validation cohort: all admission encounters from January 2014 to June 2017 from a fourth hospital in the Emory Healthcare network (40,143). Temporal validation cohort: all admission encounters from February to April 2020 from four hospitals in the Emory Healthcare network coronavirus disease tested (2,564) and coronavirus disease positive (389). All admission encounters had vital signs, laboratory, and demographic data extracted. Exclusion criteria included invasive mechanical ventilation started within the operating room or advanced respiratory support within the first 8 hours of admission. Encounters were discretized into hour intervals from 8 hours after admission to discharge or advanced respiratory support initiation and binary labeled for advanced respiratory support. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment, our eXtreme Gradient Boosting-based algorithm, was compared against Modified Early Warning Score. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment had significantly better discrimination than Modified Early Warning Score (area under the receiver operating characteristic curve 0.85 vs 0.57 [test], 0.84 vs 0.61 [external validation]). Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment maintained a positive predictive value (0.31-0.21) similar to that of Modified Early Warning Score greater than 4 (0.29-0.25) while identifying 6.62 (validation) to 9.58 (test) times more true positives. Furthermore, Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment performed more effectively in temporal validation (area under the receiver operating characteristic curve 0.86 [coronavirus disease tested], 0.93 [coronavirus disease positive]), while achieving identifying 4.25-4.51× more true positives. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment is more effective than Modified Early Warning Score in predicting respiratory failure requiring advanced respiratory support at external validation and in coronavirus disease 2019 patients. Silent prospective validation necessary before local deployment.
Sections du résumé
BACKGROUND
BACKGROUND
Acute respiratory failure occurs frequently in hospitalized patients and often begins outside the ICU, associated with increased length of stay, cost, and mortality. Delays in decompensation recognition are associated with worse outcomes.
OBJECTIVES
OBJECTIVE
The objective of this study is to predict acute respiratory failure requiring any advanced respiratory support (including noninvasive ventilation). With the advent of the coronavirus disease pandemic, concern regarding acute respiratory failure has increased.
DERIVATION COHORT
UNASSIGNED
All admission encounters from January 2014 to June 2017 from three hospitals in the Emory Healthcare network (82,699).
VALIDATION COHORT
UNASSIGNED
External validation cohort: all admission encounters from January 2014 to June 2017 from a fourth hospital in the Emory Healthcare network (40,143). Temporal validation cohort: all admission encounters from February to April 2020 from four hospitals in the Emory Healthcare network coronavirus disease tested (2,564) and coronavirus disease positive (389).
PREDICTION MODEL
UNASSIGNED
All admission encounters had vital signs, laboratory, and demographic data extracted. Exclusion criteria included invasive mechanical ventilation started within the operating room or advanced respiratory support within the first 8 hours of admission. Encounters were discretized into hour intervals from 8 hours after admission to discharge or advanced respiratory support initiation and binary labeled for advanced respiratory support. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment, our eXtreme Gradient Boosting-based algorithm, was compared against Modified Early Warning Score.
RESULTS
RESULTS
Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment had significantly better discrimination than Modified Early Warning Score (area under the receiver operating characteristic curve 0.85 vs 0.57 [test], 0.84 vs 0.61 [external validation]). Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment maintained a positive predictive value (0.31-0.21) similar to that of Modified Early Warning Score greater than 4 (0.29-0.25) while identifying 6.62 (validation) to 9.58 (test) times more true positives. Furthermore, Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment performed more effectively in temporal validation (area under the receiver operating characteristic curve 0.86 [coronavirus disease tested], 0.93 [coronavirus disease positive]), while achieving identifying 4.25-4.51× more true positives.
CONCLUSIONS
CONCLUSIONS
Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment is more effective than Modified Early Warning Score in predicting respiratory failure requiring advanced respiratory support at external validation and in coronavirus disease 2019 patients. Silent prospective validation necessary before local deployment.
Identifiants
pubmed: 34079945
doi: 10.1097/CCE.0000000000000402
pmc: PMC8162520
doi:
Types de publication
Journal Article
Langues
eng
Pagination
e0402Subventions
Organisme : NCATS NIH HHS
ID : KL2 TR002381
Pays : United States
Informations de copyright
Copyright © 2021 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of the Society of Critical Care Medicine.
Déclaration de conflit d'intérêts
Dr. Wong is supported by the National Institute of General Medical Sciences (NIGMS) 2T32GM095442 and the Clinical and Translational Science Award pilot informatics grant by National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) under UL1TR002378. He holds equity and management roles in Ataia Medical. Dr. Kamaleswaran is supported by the Michael J. Fox Foundation (Grant No. 17267). Dr. Reyna is supported by NIH U54EB027690 and HHS0100201900015C. Dr. Josef is supported by the NIGMS 2T32GM095442. Dr. Holder is supported by the NIGMS under award number K23GM137182 for Advancing Translational Sciences of the NIH under Award Number UL1TR002378. Dr. Nemati is supported by the NIH (No. K01ES025445) and the Gordon and Betty Moore Foundation (No. GBMF9052). Dr. Buchman is supported by the Society of Critical Care Medicine and the Biomedical Advanced Research and Development Authority. He is an Editor in Chief for Critical Care Medicine and has recused himself from editorial influence on this article. Dr. Blum is supported by the NCATS of the NIH under Award Number UL1TR002378. He is a consultant for Clew Medical. The remaining authors have disclosed that they do not have any potential conflicts of interest.
Références
QJM. 2001 Oct;94(10):521-6
pubmed: 11588210
J Biomed Inform. 2016 Dec;64:10-19
pubmed: 27658885
Resuscitation. 2018 Feb;123:86-91
pubmed: 29169912
Crit Care Med. 2017 Jan;45(1):75-84
pubmed: 27526267
JAMA. 2020 May 26;323(20):2052-2059
pubmed: 32320003
Crit Care. 2018 Oct 30;22(1):286
pubmed: 30373653
BMJ Open. 2016 Jun 10;6(6):e011347
pubmed: 27288382
Ann Intern Med. 2015 Jan 6;162(1):W1-73
pubmed: 25560730
Crit Care Med. 2020 Sep;48(9):e799-e804
pubmed: 32452888
Am J Respir Crit Care Med. 2015 Oct 15;192(8):958-64
pubmed: 26158402
J Clin Monit Comput. 2019 Aug;33(4):713-724
pubmed: 30264218
Crit Care Med. 2020 May;48(5):623-633
pubmed: 32141923
JAMA. 2020 Apr 28;323(16):1612-1614
pubmed: 32191259
PLoS Med. 2015 Oct 06;12(10):e1001885
pubmed: 26440803
Eur Heart J. 2014 Aug 1;35(29):1925-31
pubmed: 24898551
Chest. 2011 Dec;140(6):1447-1455
pubmed: 21998258
J Surg Res. 2018 Aug;228:179-187
pubmed: 29907209
Methods Inf Med. 2016 May 17;55(3):234-41
pubmed: 25925616
Crit Care Med. 2015 Oct;43(10):2059-65
pubmed: 26181217
N Engl J Med. 2020 May 21;382(21):2012-2022
pubmed: 32227758
Epidemiology. 2010 Jan;21(1):128-38
pubmed: 20010215