Prospective Evaluation of a Dynamic Acuity Score for Regularly Assessing a Critically Ill Patient's Risk of Mortality.
Journal
Critical care medicine
ISSN: 1530-0293
Titre abrégé: Crit Care Med
Pays: United States
ID NLM: 0355501
Informations de publication
Date de publication:
01 10 2023
01 10 2023
Historique:
medline:
15
9
2023
pubmed:
29
5
2023
entrez:
29
5
2023
Statut:
ppublish
Résumé
Predictive models developed for use in ICUs have been based on retrospectively collected data, which does not take into account the challenges associated with live, clinical data. This study sought to determine if a previously constructed predictive model of ICU mortality (ViSIG) is robust when using data collected prospectively in near real-time. Prospectively collected data were aggregated and transformed to evaluate a previously developed rolling predictor of ICU mortality. Five adult ICUs at Robert Wood Johnson-Barnabas University Hospital and one adult ICU at Stamford Hospital. One thousand eight hundred and ten admissions from August to December 2020. The ViSIG Score, comprised of severity weights for heart rate, respiratory rate, oxygen saturation, mean arterial pressure, mechanical ventilation, and values for OBS Medical's Visensia Index. This information was collected prospectively, whereas data on discharge disposition was collected retrospectively to measure the ViSIG Score's accuracy. The distribution of patients' maximum ViSIG Score was compared with ICU mortality rate, and cut points determined where changes in mortality probability were greatest. The ViSIG Score was validated on new admissions. The ViSIG Score was able to stratify patients into three groups: 0-37 (low risk), 38-58 (moderate risk), and 59-100 (high risk), with mortality of 1.7%, 12.0%, and 39.8%, respectively ( p < 0.001). The sensitivity and specificity of the model to predict mortality for the high-risk group were 51% and 91%. Performance on the validation dataset remained high. There were similar increases across risk groups for length of stay, estimated costs, and readmission. Using prospectively collected data, the ViSIG Score produced risk groups for mortality with good sensitivity and excellent specificity. A future study will evaluate making the ViSIG Score visible to clinicians to determine whether this metric can influence clinician behavior to reduce adverse outcomes.
Identifiants
pubmed: 37246915
doi: 10.1097/CCM.0000000000005931
pii: 00003246-990000000-00158
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1285-1293Informations de copyright
Copyright © 2023 by the Society of Critical Care Medicine and Wolters Kluwer Health, Inc. All Rights Reserved.
Déclaration de conflit d'intérêts
Dr. Lissauer’s institution received funding from Prescient Healthcare Consulting; he received funding from Leon Piechta Esq, Lacava, Jacobs and Goodis, Saltz Mongeluzzi and Bendesky, Rugers University, and Hartford Healthcare Medical Group. The remaining authors have not disclosed any potential conflicts of interest.
Références
Kramer AA, Zimmerman JE, Knaus WA: Severity of illness and predictive models in the society of critical care medicine’s first 50 years: A tale of concord and conflict. Crit Care Med 2021; 49:728–740
Royal College of Physicians: National Early Warning Score (NEWS): Standardising the Assessment of Acute Illness Severity in the NHS. Report of a Working Party, London, RCP, 2012
Royal College of Physicians: National Early Warning Score (NEWS) 2: Standardising the assessment of acute-illness severity in the NHS: Updated report of a working party. 2017. Available at: https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2 . Accessed May 4, 2022
Churpek MM, Yuen TC, Winslow C, et al.: Multicenter development and validation of a risk stratification tool for ward patients. Am J Respir Crit Care Med 2014; 190:649–655
Alarhayem AQ, Muir MT, Jenkins DJ, et al.: Application of electronic medical record-derived analytics in critical care: Rothman Index predicts mortality and readmissions in surgical intensive care unit patients. J Trauma Acute Care Surg 2019; 86:635–641
Shickel B, Loftus TJ, Adhikari L, et al.: DeepSOFA: “A continuous acuity score for critically ill patients using clinically interpretable deep learning.”. Sci Rep 2019; 9:1879
Moss TJ, Lake DE, Calland JF, et al.: Signatures of subacute potentially catastrophic illness in the ICU: Model development and validation. Crit Care Med 2016; 44:1639–1648
Kunitomo Y, Thomas A, Chouairi F, et al.: Electronic health record risk score provides earlier prognostication of clinical outcomes in patients admitted to the cardiac intensive care unit. Am Heart J 2021; 238:85–88
Churpek MM, Edelson DP: Scratching the surface of clinical deterioration with deep learning. Crit Care Med 2021; 49:1366–1368
Kramer AA: A novel method using vital signs information for assistance in making a discharge decision from the intensive care unit: Identification of those patients at highest risk of mortality on the floor or discharge to a hospice. Med Res Archives 2017; 5:1–12
Kramer AA: A continuously updated predictive analytics model for the timely detection of critically ill patients with a high risk of mortality. Med Res Archives 2019; 7:1–12
Kramer AA: Using genetic algorithms to identify deleterious patterns of physiologic data for near real-time prediction of mortality in critically ill patients. Inf Med Unlocked 2021; 26:100754
Tarassenko L, Hann A, Young D: Integrated monitoring and analysis for early warning of patient deterioration. Brit J Anaesth 2006; 97:64–68
Hravnak M, Edwards L, Clontz A, et al.: Defining the incidence of cardiorespiratory instability in patients in step-down units using an electronic integrated monitoring system. Arch Intern Med 2008; 168:1300–1308
Reardon PM, Seely AJE, Fernando SM, et al.: Can early warning systems enhance detection of high risk patients by rapid response teams?. J Int Care Med 2021; 36:542–549
Hravnak M, DeVita MA, Clontz A, et al.: Cardiorespiratory instability before and after implementing an integrated monitoring system. Crit Care Med 2011; 39:65–72
Goodman ED. “Introduction to genetic algorithms,” GECCO ‘13 Companion: Proceedings of the 15th annual conference companion on Genetic and evolutionary computation, July 2013: 225–246
Kramer AA, Dasta JK, Kane-Gill SL: The impact of mortality on total costs within the ICU. Crit Care Med 2017; 45:1457–1463
Sheth M, Gerovitch A, Welsch R, et al.: The Univariate Flagging Algorithm (UFA): An interpretable approach for predictive modeling. PLoS One 2019; 14:e0223161
Leisman DE: Rare events in the ICU: An emerging challenge in classification and prediction. Crit Care Med 2018; 46:418–424
Romero-Brufau S, Huddleston JM, Escobar GJ, et al.: Why the C-statistic is not informative to evaluate early warning scores and what metrics to use. Crit Care 2015; 19:1–6
Blum JM: Beware of the magic eight ball in medicine. Crit Care Med 2019; 47:1650–1651