Development and validation of early prediction models for new-onset functional impairment at hospital discharge of ICU admission.

Activities of daily living Functional impairment Intensive care unit Post-intensive care syndrome Prediction

Journal

Intensive care medicine
ISSN: 1432-1238
Titre abrégé: Intensive Care Med
Pays: United States
ID NLM: 7704851

Informations de publication

Date de publication:
06 2022
Historique:
received: 21 01 2022
accepted: 21 03 2022
pubmed: 2 4 2022
medline: 22 6 2022
entrez: 1 4 2022
Statut: ppublish

Résumé

We aimed to develop and validate models for predicting new-onset functional impairment after intensive care unit (ICU) admission with predictors routinely collected within 2 days of admission. In this multi-center retrospective cohort study of acute care hospitals in Japan, we identified adult patients who were admitted to the ICU with independent activities of daily living before hospitalization and survived for at least 2 days from April 2014 to October 2020. The primary outcome was functional impairment defined as Barthel Index ≤ 60 at hospital discharge. In the internal validation dataset (April 2014 to March 2019), using routinely collected 94 candidate predictors within 2 days of ICU admission, we trained and tuned the six conventional and machine-learning models with repeated random sub-sampling cross-validation. We computed the variable importance of each predictor to the models. In the temporal validation dataset (April 2019 to October 2020), we measured the performance of these models. We identified 19,846 eligible patients. Functional impairment at discharge was developed in 33% of patients (n = 6488/19,846). In the temporal validation dataset, all six models showed good discrimination ability with areas under the curve above 0.86, and the differences among the six models were negligible. Variable importance revealed newly detected early predictors, including worsened neurologic conditions and catabolism biomarkers such as decreased serum albumin and increased blood urea nitrogen. We successfully developed early prediction models of new-onset functional impairment after ICU admission that achieved high performance using only data routinely collected within 2 days of ICU admission.

Identifiants

pubmed: 35362765
doi: 10.1007/s00134-022-06688-z
pii: 10.1007/s00134-022-06688-z
doi:

Types de publication

Journal Article Multicenter Study Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

679-689

Subventions

Organisme : Ministry of Health, Labour and Welfare
ID : 21AA2007
Organisme : Ministry of Health, Labour and Welfare
ID : 20AA2005
Organisme : Ministry of Education, Culture, Sports, Science and Technology
ID : 20H03907

Commentaires et corrections

Type : CommentIn
Type : CommentIn

Informations de copyright

© 2022. Springer-Verlag GmbH Germany, part of Springer Nature.

Références

Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H et al (2012) Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med 40(2):502–509. https://doi.org/10.1097/CCM.0b013e318232da75
doi: 10.1097/CCM.0b013e318232da75 pubmed: 21946660
Ingraham NE, Vakayil V, Pendleton KM, Robbins AJ, Freese RL, Northrop EF et al (2020) National trends and variation of functional status deterioration in the medically critically ill. Crit Care Med 48(11):1556–1564. https://doi.org/10.1097/CCM.0000000000004524
doi: 10.1097/CCM.0000000000004524 pubmed: 32886469 pmcid: 8033631
Chelluri L, Pinsky MR, Donahoe MP, Grenvik A (1993) Long-term outcome of critically ill elderly patients requiring intensive care. JAMA 269(24):3119–3123. https://doi.org/10.1001/jama.269.24.3119
doi: 10.1001/jama.269.24.3119 pubmed: 8505814
Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794. https://doi.org/10.1001/jama.2010.1553
doi: 10.1001/jama.2010.1553 pubmed: 20978258 pmcid: 3345288
Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F et al (2003) One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med 348(8):683–693. https://doi.org/10.1056/NEJMoa022450
doi: 10.1056/NEJMoa022450 pubmed: 12594312
Dowdy DW, Eid MP, Sedrakyan A, Mendez-Tellez PA, Pronovost PJ, Herridge MS, Needham DM (2005) Quality of life in adult survivors of critical illness: a systematic review of the literature. Intensive Care Med 31(5):611–620. https://doi.org/10.1007/s00134-005-2592-6
doi: 10.1007/s00134-005-2592-6 pubmed: 15803303
Ferrante LE, Pisani MA, Murphy TE, Gahbauer EA, Leo-Summers LS, Gill TM (2015) Functional trajectories among older persons before and after critical illness. JAMA Intern Med 175(4):523–529. https://doi.org/10.1001/jamainternmed.2014.7889
doi: 10.1001/jamainternmed.2014.7889 pubmed: 25665067 pmcid: 4467795
Harvey MA, Davidson JE (2016) Postintensive care syndrome: right care, right now…and later. Crit Care Med 44(2):381–385. https://doi.org/10.1097/CCM.0000000000001531
doi: 10.1097/CCM.0000000000001531 pubmed: 26771784
Inoue S, Hatakeyama J, Kondo Y, Hifumi T, Sakuramoto H, Kawasaki T et al (2019) Post-intensive care syndrome: its pathophysiology, prevention, and future directions. Acute Med Surg 6(3):233–246. https://doi.org/10.1002/ams2.415
doi: 10.1002/ams2.415 pubmed: 31304024 pmcid: 6603316
Turnbull AE, Davis WE, Needham DM, White DB, Eakin MN (2016) Intensivist-reported facilitators and barriers to discussing post-discharge outcomes with Intensive Care Unit surrogates. A qualitative study. Ann Am Thorac Soc 13(9):1546–1552. https://doi.org/10.1513/AnnalsATS.201603-212OC
doi: 10.1513/AnnalsATS.201603-212OC pubmed: 27294981 pmcid: 5059504
Schandl A, Bottai M, Holdar U, Hellgren E, Sackey P (2014) Early prediction of new-onset physical disability after intensive care unit stay: a preliminary instrument. Crit Care 18(4):455. https://doi.org/10.1186/s13054-014-0455-7
doi: 10.1186/s13054-014-0455-7 pubmed: 25079385 pmcid: 4243809
Oeyen S, Vermeulen K, Benoit D, Annemans L, Decruyenaere J (2018) Development of a prediction model for long-term quality of life in critically ill patients. J Crit Care 43:133–138. https://doi.org/10.1016/j.jcrc.2017.09.006
doi: 10.1016/j.jcrc.2017.09.006 pubmed: 28892669
Detsky ME, Harhay MO, Bayard DF, Delman AM, Buehler AE, Kent SA et al (2017) Six-month morbidity and mortality among intensive care unit patients receiving life-sustaining therapy. A prospective cohort study. Ann Am Thorac Soc 14(10):1562–1570. https://doi.org/10.1513/AnnalsATS.201611-875OC
doi: 10.1513/AnnalsATS.201611-875OC pubmed: 28622004 pmcid: 5718567
Higgins AM, Neto AS, Bailey M, Barrett J, Bellomo R, Cooper DJ et al (2021) Predictors of death and new disability after critical illness: a multicentre prospective cohort study. Intensive Care Med 47(7):772–781. https://doi.org/10.1007/s00134-021-06438-7
doi: 10.1007/s00134-021-06438-7 pubmed: 34089063
Wubben N, van den Boogaard M, Ramjith J, Bisschops LLA, Frenzel T, van der Hoeven JG, Zegers M (2021) Development of a practically usable prediction model for quality of life of ICU survivors: a sub-analysis of the MONITOR-IC prospective cohort study. J Crit Care 65:76–83. https://doi.org/10.1016/j.jcrc.2021.04.019
doi: 10.1016/j.jcrc.2021.04.019 pubmed: 34111683
Haines KJ, Hibbert E, McPeake J, Anderson BJ, Bienvenu OJ, Andrews A et al (2020) Prediction models for physical, cognitive, and mental health impairments after critical illness: a systematic review and critical appraisal. Crit Care Med 48(12):1871–1880. https://doi.org/10.1097/CCM.0000000000004659
doi: 10.1097/CCM.0000000000004659 pubmed: 33060502 pmcid: 7673641
Taniguchi Y, Kuno T, Komiyama J, Adomi M, Suzuki T, Abe T et al (2022) Comparison of patient characteristics and in-hospital mortality between patients with COVID-19 in 2020 and those with influenza in 2017–2020: a multicenter, retrospective cohort study in Japan. Lancet Reg Health West Pac 20:100365. https://doi.org/10.1016/j.lanwpc.2021.100365
doi: 10.1016/j.lanwpc.2021.100365 pubmed: 35005672 pmcid: 8720491
Miyawaki A, Tomio J, Nakamura M, Ninomiya H, Kobayashi Y (2021) Changes in surgeries and therapeutic procedures during the COVID-19 outbreak: a longitudinal study of acute care hospitals in Japan. Ann Surg 273(4):e132–e134. https://doi.org/10.1097/SLA.0000000000004528
doi: 10.1097/SLA.0000000000004528 pubmed: 33214438
Collins GS, Reitsma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Surg 102(3):148–158. https://doi.org/10.1002/bjs.9736
doi: 10.1002/bjs.9736 pubmed: 25627261
Ohbe H, Sasabuchi Y, Kumazawa R, Matsui H, Yasunaga H (2021) Intensive care unit occupancy in Japan, 2015–2018: a nationwide inpatient database study. J Epidemiol. https://doi.org/10.2188/jea.JE20210016
doi: 10.2188/jea.JE20210016 pubmed: 33840654 pmcid: 7878706
Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA (2004) New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol 57(12):1288–1294. https://doi.org/10.1016/j.jclinepi.2004.03.012
doi: 10.1016/j.jclinepi.2004.03.012 pubmed: 15617955
Irie H, Okamoto H, Uchino S, Endo H, Uchida M, Kawasaki T et al (2020) The Japanese Intensive care PAtient Database (JIPAD): a national intensive care unit registry in Japan. J Crit Care 55:86–94. https://doi.org/10.1016/j.jcrc.2019.09.004
doi: 10.1016/j.jcrc.2019.09.004 pubmed: 31715536
Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H et al (1996) The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 22(7):707–710. https://doi.org/10.1007/BF01709751
doi: 10.1007/BF01709751 pubmed: 8844239
Yamana H, Moriwaki M, Horiguchi H, Kodan M, Fushimi K, Yasunaga H (2017) Validity of diagnoses, procedures, and laboratory data in Japanese administrative data. J Epidemiol 27(10):476–482. https://doi.org/10.1016/j.je.2016.09.009
doi: 10.1016/j.je.2016.09.009 pubmed: 28142051 pmcid: 5602797
Schweickert WD, Pohlman MC, Pohlman AS, Nigos C, Pawlik AJ, Esbrook CL et al (2009) Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet 373(9678):1874–1882. https://doi.org/10.1016/S0140-6736(09)60658-9
doi: 10.1016/S0140-6736(09)60658-9 pubmed: 19446324
Scheffenbichler FT, Teja B, Wongtangman K, Mazwi N, Waak K, Schaller SJ et al (2021) Effects of the level and duration of mobilization therapy in the surgical ICU on the loss of the ability to live independently: an international prospective cohort study. Crit Care Med 49(3):e247–e257. https://doi.org/10.1097/CCM.0000000000004808
doi: 10.1097/CCM.0000000000004808 pubmed: 33416257 pmcid: 7902391
Mahoney FI, Barthel DW (1965) Functional evaluation: the Barthel index. Md State Med J 14:61–65
pubmed: 14258950
Guyatt GH, Deyo RA, Charlson M, Levine MN, Mitchell A (1989) Responsiveness and validity in health status measurement: a clarification. J Clin Epidemiol 42(5):403–408. https://doi.org/10.1016/0895-4356(89)90128-5
doi: 10.1016/0895-4356(89)90128-5 pubmed: 2659745
Uyttenboogaart M, Stewart RE, Vroomen PCAJ, De Keyser J, Luijckx GJ (2005) Optimizing cutoff scores for the Barthel index and the modified Rankin scale for defining outcome in acute stroke trials. Stroke 36(9):1984–1987. https://doi.org/10.1161/01.STR.0000177872.87960.61
doi: 10.1161/01.STR.0000177872.87960.61 pubmed: 16081854
Austin PC, van Klaveren D, Vergouwe Y, Nieboer D, Lee DS, Steyerberg EW (2016) Geographic and temporal validity of prediction models: different approaches were useful to examine model performance. J Clin Epidemiol 79:76–85. https://doi.org/10.1016/j.jclinepi.2016.05.007
doi: 10.1016/j.jclinepi.2016.05.007 pubmed: 27262237 pmcid: 5708595
Saar-Tsechansky M, Provost F (2007) Handling missing values when applying classification models. J Mach Learn Res 8:1625–1657
Kuhn M (2022) The caret package. https://topepo.github.io/caret/ . Accessed 3 Jan 2022
Beam AL, Kohane IS (2018) Big data and machine learning in health care. JAMA 319(13):1317–1318. https://doi.org/10.1001/jama.2017.18391
doi: 10.1001/jama.2017.18391 pubmed: 29532063
Steyerberg EW (2018) Validation in prediction research: the waste by data splitting. J Clin Epidemiol 103:131–133. https://doi.org/10.1016/j.jclinepi.2018.07.010
doi: 10.1016/j.jclinepi.2018.07.010 pubmed: 30063954
varImp function—RDocumentation. https://www.rdocumentation.org/packages/caret/versions/6.0-90/topics/varImp Accessed 3 Jan 2022
Mikkelsen ME, Still M, Anderson BJ, Bienvenu OJ, Brodsky MB, Brummel N et al (2020) Society of Critical Care Medicine’s international consensus conference on prediction and identification of long-term impairments after critical illness. Crit Care Med 48(11):1670–1679. https://doi.org/10.1097/CCM.0000000000004586
doi: 10.1097/CCM.0000000000004586 pubmed: 32947467
Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS et al (2019) PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med 170(1):51–58. https://doi.org/10.7326/M18-1376
doi: 10.7326/M18-1376 pubmed: 30596875
Sturm JW, Dewey HM, Donnan GA, Macdonell RAL, McNeil JJ, Thrift AG (2002) Handicap after stroke: how does it relate to disability, perception of recovery, and stroke subtype?: the north North East Melbourne Stroke Incidence Study (NEMESIS). Stroke 33(3):762–768. https://doi.org/10.1161/hs0302.103815
doi: 10.1161/hs0302.103815 pubmed: 11872901
van der Vorst A, Zijlstra GAR, Witte ND, Duppen D, Stuck AE, Kempen GIJM et al (2016) Limitations in activities of daily living in community-dwelling people aged 75 and over: a systematic literature review of risk and protective factors. PLoS ONE 11(10):e0165127. https://doi.org/10.1371/journal.pone.0165127
doi: 10.1371/journal.pone.0165127 pubmed: 27760234 pmcid: 5070862
Nicholson JP, Wolmarans MR, Park GR (2000) The role of albumin in critical illness. Br J Anaesth 85(4):599–610. https://doi.org/10.1093/bja/85.4.599
doi: 10.1093/bja/85.4.599 pubmed: 11064620
Haines RW, Zolfaghari P, Wan Y, Pearse RM, Puthucheary Z, Prowle JR (2019) Elevated urea-to-creatinine ratio provides a biochemical signature of muscle catabolism and persistent critical illness after major trauma. Intensive Care Med 45(12):1718–1731. https://doi.org/10.1007/s00134-019-05760-5
doi: 10.1007/s00134-019-05760-5 pubmed: 31531715
Gentile LF, Cuenca AG, Efron PA, Ang D, Bihorac A, McKinley BA et al (2012) Persistent inflammation and immunosuppression: a common syndrome and new horizon for surgical intensive care. J Trauma Acute Care Surg 72(6):1491–1501. https://doi.org/10.1097/TA.0b013e318256e000
doi: 10.1097/TA.0b013e318256e000 pubmed: 22695412 pmcid: 3705923
Azoulay E, Kentish-Barnes N, Pochard F (2008) Health-related quality of life: an outcome variable in critical care survivors. Chest 133(2):339–341. https://doi.org/10.1378/chest.07-2547
doi: 10.1378/chest.07-2547 pubmed: 18252911
Govindan S, Iwashyna TJ, Watson SR, Hyzy RC, Miller MA (2014) Issues of survivorship are rarely addressed during intensive care unit stays. Baseline results from a statewide quality improvement collaborative. Ann Am Thorac Soc 11(4):587–591. https://doi.org/10.1513/AnnalsATS.201401-007BC
doi: 10.1513/AnnalsATS.201401-007BC pubmed: 24605936 pmcid: 4225798
van Zanten ARH, De Waele E, Wischmeyer PE (2019) Nutrition therapy and critical illness: practical guidance for the ICU, post-ICU, and long-term convalescence phases. Crit Care 23(1):368. https://doi.org/10.1186/s13054-019-2657-5
doi: 10.1186/s13054-019-2657-5 pubmed: 31752979 pmcid: 6873712
Vollmer S, Mateen BA, Bohner G, Király FJ, Ghani R, Jonsson P et al (2020) Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 368:l6927. https://doi.org/10.1136/bmj.l6927
doi: 10.1136/bmj.l6927 pubmed: 32198138
Collins GS, Dhiman P, Andaur Navarro CL, Ma J, Hooft L, Reitsma JB et al (2021) Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open 11(7):e048008. https://doi.org/10.1136/bmjopen-2020-048008
doi: 10.1136/bmjopen-2020-048008 pubmed: 34244270 pmcid: 8273461
Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B (2019) A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol 110:12–22. https://doi.org/10.1016/j.jclinepi.2019.02.004
doi: 10.1016/j.jclinepi.2019.02.004 pubmed: 30763612
Uemura Y, Shibata R, Takemoto K, Koyasu M, Ishikawa S, Murohara T, Watarai M (2018) Prognostic impact of the preservation of activities of daily living on post-discharge outcomes in patients with acute heart failure. Circ J 82(11):2793–2799. https://doi.org/10.1253/circj.CJ-18-0279
doi: 10.1253/circj.CJ-18-0279 pubmed: 30158344
Sato M, Mutai H, Yamamoto S, Tsukakoshi D, Takeda S, Oguchi N et al (2021) Decreased activities of daily living at discharge predict mortality and readmission in elderly patients after cardiac and aortic surgery: a retrospective cohort study. Medicine (Baltimore) 100(31):e26819. https://doi.org/10.1097/MD.0000000000026819
doi: 10.1097/MD.0000000000026819

Auteurs

Hiroyuki Ohbe (H)

Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan. hohbey@gmail.com.

Tadahiro Goto (T)

Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.
TXP Medical Co. Ltd, 7-3-1-252 Hongo, Bunkyo-ku, Tokyo, 113-8454, Japan.

Kensuke Nakamura (K)

Department of Emergency and Critical Care Medicine, Hitachi General Hospital, 2-1-1 Jonantyo, Hitachi, Ibaraki, 317-0077, Japan.

Hiroki Matsui (H)

Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.

Hideo Yasunaga (H)

Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH