Predicting ICU Mortality in Acute Respiratory Distress Syndrome Patients Using Machine Learning: The Predicting Outcome and STratifiCation of severity in ARDS (POSTCARDS) Study.
Journal
Critical care medicine
ISSN: 1530-0293
Titre abrégé: Crit Care Med
Pays: United States
ID NLM: 0355501
Informations de publication
Date de publication:
01 Dec 2023
01 Dec 2023
Historique:
medline:
17
11
2023
pubmed:
31
8
2023
entrez:
31
8
2023
Statut:
ppublish
Résumé
To assess the value of machine learning approaches in the development of a multivariable model for early prediction of ICU death in patients with acute respiratory distress syndrome (ARDS). A development, testing, and external validation study using clinical data from four prospective, multicenter, observational cohorts. A network of multidisciplinary ICUs. A total of 1,303 patients with moderate-to-severe ARDS managed with lung-protective ventilation. None. We developed and tested prediction models in 1,000 ARDS patients. We performed logistic regression analysis following variable selection by a genetic algorithm, random forest and extreme gradient boosting machine learning techniques. Potential predictors included demographics, comorbidities, ventilatory and oxygenation descriptors, and extrapulmonary organ failures. Risk modeling identified some major prognostic factors for ICU mortality, including age, cancer, immunosuppression, Pa o2 /F io2 , inspiratory plateau pressure, and number of extrapulmonary organ failures. Together, these characteristics contained most of the prognostic information in the first 24 hours to predict ICU mortality. Performance with machine learning methods was similar to logistic regression (area under the receiver operating characteristic curve [AUC], 0.87; 95% CI, 0.82-0.91). External validation in an independent cohort of 303 ARDS patients confirmed that the performance of the model was similar to a logistic regression model (AUC, 0.91; 95% CI, 0.87-0.94). Both machine learning and traditional methods lead to promising models to predict ICU death in moderate/severe ARDS patients. More research is needed to identify markers for severity beyond clinical determinants, such as demographics, comorbidities, lung mechanics, oxygenation, and extrapulmonary organ failure to guide patient management.
Identifiants
pubmed: 37651262
doi: 10.1097/CCM.0000000000006030
pii: 00003246-990000000-00199
doi:
Types de publication
Journal Article
Multicenter Study
Observational Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
1638-1649Subventions
Organisme : Canadian Institutes for Health Research
ID : 137772
Organisme : Canadian Institutes for Health Research
ID : FDN 143285
Investigateurs
Alfonso Ambrós
(A)
Rafael Del Campo
(R)
Ana Bueno-González
(A)
Carmen Hornos-López
(C)
Lidia Pita-García
(L)
Ana M Díaz-Lamas
(AM)
Regina Arrojo
(R)
Juan A Soler
(JA)
Luís A Conesa-Cayuela
(LA)
Ana M Del Saz-Ortiz
(AM)
Lucia Capilla
(L)
Lorena Fernández
(L)
Jesús Blanco
(J)
Arturo Muriel
(A)
Pablo Blanco-Schweizer
(P)
César Aldecoa
(C)
Jesús Rico-Feijoo
(J)
Alba Pérez
(A)
Silvia Martín-Alfonso
(S)
Ana M Domínguez
(AM)
Francisco J Díaz-Domínguez
(FJ)
Raúl I González-Luengo
(RI)
Demetrio Carriedo
(D)
Marina Soro
(M)
Javier Belda
(J)
Andrea Gutiérrez
(A)
Gerardo Aguilar
(G)
Carlos Ferrando
(C)
Belén Civantos
(B)
Mónica Hernández
(M)
David Andaluz
(D)
Leonor Nogales
(L)
Dácil Parrilla
(D)
Eduardo Peinado
(E)
Lina Pérez-Méndez
(L)
Elena González-Higueras
(E)
Anxela Vidal
(A)
César Pérez
(C)
Robert M Kacmarek
(RM)
Informations de copyright
Copyright © 2023 by the Society of Critical Care Medicine and Wolters Kluwer Health, Inc. All Rights Reserved.
Déclaration de conflit d'intérêts
Drs. Martín-Rodríguez and Rodríguez-Suárez received support for article research from the National Institutes of Health. Dr. Rodríguez-Suárez disclosed work for government. Dr. Szakmany received funding from PAION UK and Thermo Fisher UK; he disclosed that they are a trustee of Intensive Care National Audit & Research Centre and an Associate Editor for Social Media for Critical Care Explorations. Dr. Slutsky received funding from Signal-1. Dr. Villar, Dr. Añón, Dr. Ferrando, Ms. Fernández, and Dr. González-Martin received grant support from the Instituto de Salud Carlos III, Madrid, Spain (CB06/06/1088). Dr. Hernández-González is a Serra Húnter fellow. Dr. Slutsky was funded by the Canadian Institutes of Health Research (grants numbers 137772 and FDN143285). The remaining authors have disclosed that they do not have any potential conflicts of interest.
Références
Villar J, Slutsky AS: Golden anniversary of the acute respiratory distress syndrome: Still much work to do!. Curr Opin Crit Care. 2017; 23:4–9
Ferring M, Vincent JL: Is outcome from ARDS related to the severity of respiratory failure? Eur Respir J. 1997; 10:1297–1300
Villar J, Blanco J, del Campo R, et al.; Spanish Initiative for Epidemiology, Stratification & Therapies for ARDS (SIESTA) Network: Assessment of PaO 2 /FiO 2 for stratification of patients with moderate and severe acute respiratory distress syndrome. BMJ Open. 2015; 5:e006812
Villar J, González-Martín JM, Ambrós A, et al.; Spanish Initiative for Epidemiology, Stratification and Therapies of ARDS (SIESTA) Network: Stratification for identification of prognostic categories in the acute respiratory distress syndrome (SPIRES) score. Crit Care Med. 2021; 49:e920–e930
Brower RG, Matthay MA, Morris A, et al.; Acute Respiratory Distress Syndrome Network: Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000; 342:1301–1308
Guerin C, Reignier J, Richard JC, et al.; PROSEVA Study Group: The PROSEVA Study Group: Prone positioning in severe acute respiratory distress syndrome. N Engl J Med. 2013; 368:2159–2168
Moss M, Huang DT, Brower RG, et al.; National Heart, Lung, and Blood Institute PETAL Clinical Trials Network: Early neuromuscular blockade in the acute respiratory distress syndrome. N Engl J Med. 2019; 380:1997–2008
Combes A, Hajage D, Capellier G, et al.; EOLIA Trial Group, REVA, and ECMONet: Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome. N Engl J Med. 2018; 378:1965–1975
Villar J, Ferrando C, Martínez D, et al.; dexamethasone in ARDS network: Dexamethasone treatment for the acute respiratory distress syndrome: A multicentre, randomised controlled trial. Lancet Respir Med. 2020; 8:267–276
Maslove DM, Tang B, Shankar-Hari M, et al.: Redefining critical illness. Nature Med. 2022; 28:1141–1148
Ranieri VM, Rubenfeld GD, Thompson BT, et al.; ARDS Definition Task Force: Acute respiratory distress syndrome: The Berlin definition. JAMA. 2012; 307:2526–2533
Pirrachio R, Petersn ML, Carone M, et al.: Mortality prediction in intensive care units with the Super ICU Learner Algorith (SICULA): A population-based study. Lancet Respir Med. 2015; 3:42–52
Nemati S, Holder A, Razmi F, et al.: An interpretable machine learning model for accurate prediction of sepsis in the ICU. Crit Care Med. 2018; 46:547–553
Ding XF, Li JB, Liang HY, et al.: Predictive model for acute respiratory distress syndrome events: A secondary analysis of a cohort study. J Transl Med. 2019; 17:326
Huang B, Liang D, Zon R, et al.: Mortality prediction for patients with acute respiratory distress syndrome based on machine learning: A population-based study. Ann Transl Med. 2021; 9:794
Sayed M, Riaño D, Villar J: Novel criteria to classify ARDS severity using machine learning approach. Crit Care. 2021; 25:150
Collins GS, Reitsma JB, Altman DG, et al.: Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. J Clin Epidemiol. 2015; 68:112–121
Villar J, Blanco J, Añón JM, et al.; ALIEN Network: The ALIEN study: Incidence and outcome of acute respiratory distress syndrome in the era of lung protective ventilation. Intensive Care Med. 2011; 37:1932–1941
Villar J, Pérez-Méndez L, Blanco J, et al.; Spanish Initiative for Epidemiology, Stratification, and Therapies for ARDS (SIESTA) Network: A universal definition of ARDS: The PaO 2 /FiO 2 ratio under s standard ventilatory setting – a prospective, multicenter validation study. Intensive Care Med. 2013; 39:583–592
Villar J, Mora-Ordoñez JM, Soler JA, et al.: The PANDORA study: Prevalence and outcome of acute hypoxemic respiratory failure in the pre-COVID era. Crit Care Explor. 2022; 4:e0684
Vergouwe Y, Steyerberg EW, Eijkemans MJC, et al.: Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol. 2005; 58:475–483
Leisman DE, Harhay MO, Lederer DJ, et al.: Development and reporting of prediction models: Guidance for authors from editors of respiratory, sleep, and critical care journals. Crit Care Med. 2020; 48:623–633
Knaus WA, Draper EA, Wagner DP, et al.: APACHE II: A severity of disease classification system. Crit Care Med. 1985; 13:818–829
Villar J, Pérez-Méndez L, López J, et al.; HELP Network: An early PEEP/FiO 2 trial identifies different degrees of lung injury in patients with acute respiratory distress syndrome. Am J Respir Crit Care Med. 2007; 176:795–804
Vincent JL, de Mendonça A, Cantraine F, et al.: Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: Results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998; 26:1793–1800
Villar J, Ambrós A, Mosteiro F, et al.: Age, PaO 2 /FiO 2 and plateau pressure score: A proposal for a simple outcome score in patients with acute respiratory distress syndrome. Crit Care Med. 2016; 44:1361–1369
Villar J, Martín-Rodriguez C, Dominguez-Berrot AM, et al.; Spanish Initiative for Epidemiology, Stratification and Therapies for ARDS (SIESTA) Investigators Network: A quantile analysis of plateau and driving pressure: Effects on mortality in patients with acute respiratory distress syndrome receiving lung-protective ventilation. Crit Care Med. 2017; 45:843–850
Scrucca L: GA: A package for genetic algorithms in R. J Stat Softw. 2013; 53:1–37
González-Martin JM, Sánchez-Medina AJ, Alonso JB: Optimization of the prediction of financial problems in Spanish private health companies using genetic algorithm. Gac Sanit. 2019; 33:462–467
Vrieze SI: Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). Psychol Methods. 2012; 17:228–243
Ioannidis JPA: The proposal to lower P value thresholds to 0.005. JAMA. 2018; 319:1429–1430
Gutierrez G: Artificial intelligence in the intensive care unit. Crit Care. 2020; 24:101
Rashid M, Ramakrishnan M, Pulikkel V, et al.: Artificial intelligence in acute respiratory distress syndrome: A systematic review. Artif Intell Med. 2022; 131:102361
Chen T, He T, Benesty M, et al: Xgboost: Extreme Gradient Boosting. R package version 0.4-2. 2015. R Foundation for Statistical Computing, Vienna, Austria. Available at: https://www.r-project.org/
Liaw A, Wiener M: Classification and regression by randomForest. R News. 2002; 2:18–22
Steyerberg EW, Vergouwe Y: Towards better clinical prediction models: Seven steps for development and an ABCD for validation. Eur Heart J. 2014; 35:1925–1931
Van Calster B, Nieboer D, Vergouwe Y, et al.: A calibration hierarchy for risk models was defined: From utopia to empirical data. J Clin Epidemiol. 2016; 74:167–176
Gee MH, Gottlieb JE, Albertine KH, et al.: Physiology of aging related to outcome in the adult respiratory distress syndrome. J Appl Physiol (1985). 1990; 69:822–829
Soubani AO, Shehada E, Chen W, et al.: The outcome of cancer patients with acute respiratory distress syndrome. J Crit Care. 2014; 29:183.e7–183.e12
Shiu KK, Rosen MJ: Is there a safe plateau pressure threshold for patients with acute lung injury and acute respiratory distress syndrome? Am J Respir Crit Care Med. 2006; 173:686; author reply 687
Villar J, Martínez D, Mosteiro F, et al.; Stratification and Outcome of Acute Respiratory Distress Syndrome (STANDARDS) Network: Is overall mortality the right composite endpoint in clinical trials of acute respiratory distress syndrome? Crit Care Med. 2018; 46:892–899
Møller MH, Derde LPG, Sweeney RM: Focus on clinical trial interpretation. Intensive Care Med. 2020; 46:790–792
Villar J, Ferrando C, Tusman G, et al.: Unsuccessful and successful clinical trials in acute respiratory distress syndrome: Addressing physiology-based gaps. Front Physiol. 2021; 12:774025
Juschten J, Tuinman PR, Guo T, et al.: Between-trial heterogeneity in ARDS research. Intensive Care Med. 2021; 47:422–434
Sennaar K: Machine Learning Medical Diagnostics—4 Current Applications. Emerj Artificial Intelligence Research. 2018. Available at: https://emerj.com/ai-sector-overviews/machine-learning-medical-diagnostics- 4-current- applications/ . Accessed February 27, 2023
Kacmarek RM, Berra L: Prediction of ARDS outcome: What tool should I use? Lancet Respir Med. 2018; 6:253–254
Morris AH, Stagg B, Lanspa M, et al.: Enabling a learning healthcare system with automated computer protocols that produce replicable and personalized clinical actions. J Am Med Inform Assoc. 2021; 28:1330–1344
Morris AH: Human cognitive limitations. Broad, consistent, clinical application of physiological principles will require decision support. An Am Thorac Soc. 2018; 15:S53–S56
Cowan N: The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behav Brain Sci. 2001; 24:87–114; discussion 114–185
Guerin C, Albert RK, Beitler J, et al.: Prone position in ARDS patients: Why, when, how and for whom. Intensive Care Med. 2020; 46:2385–2396
Kallet RH, Lipnick MS, Zhuo H, et al.: Characteristics of nonpulmonary organ dysfunction at onset of ARDS based on the Berlin definition. Respir Care. 2019; 64:493–501
Steyerberg EW, Vickers AJ, Cook NR, et al.: Assessing the performance of prediction models: A framework for some traditional and novel measures. Epidemiology. 2010; 21:128–138
Zhang F, Luo C, Lan C, et al.: Benchmarking feature selection methods with different prediction models on large-scale healthcare event data. BenchCouncil Transactions on Benchmarks, Standards and Evaluation. 2021; 1:100004