Development and validation of early prediction models for new-onset functional impairment at hospital discharge of ICU admission.
Activities of daily living
Functional impairment
Intensive care unit
Post-intensive care syndrome
Prediction
Journal
Intensive care medicine
ISSN: 1432-1238
Titre abrégé: Intensive Care Med
Pays: United States
ID NLM: 7704851
Informations de publication
Date de publication:
06 2022
06 2022
Historique:
received:
21
01
2022
accepted:
21
03
2022
pubmed:
2
4
2022
medline:
22
6
2022
entrez:
1
4
2022
Statut:
ppublish
Résumé
We aimed to develop and validate models for predicting new-onset functional impairment after intensive care unit (ICU) admission with predictors routinely collected within 2 days of admission. In this multi-center retrospective cohort study of acute care hospitals in Japan, we identified adult patients who were admitted to the ICU with independent activities of daily living before hospitalization and survived for at least 2 days from April 2014 to October 2020. The primary outcome was functional impairment defined as Barthel Index ≤ 60 at hospital discharge. In the internal validation dataset (April 2014 to March 2019), using routinely collected 94 candidate predictors within 2 days of ICU admission, we trained and tuned the six conventional and machine-learning models with repeated random sub-sampling cross-validation. We computed the variable importance of each predictor to the models. In the temporal validation dataset (April 2019 to October 2020), we measured the performance of these models. We identified 19,846 eligible patients. Functional impairment at discharge was developed in 33% of patients (n = 6488/19,846). In the temporal validation dataset, all six models showed good discrimination ability with areas under the curve above 0.86, and the differences among the six models were negligible. Variable importance revealed newly detected early predictors, including worsened neurologic conditions and catabolism biomarkers such as decreased serum albumin and increased blood urea nitrogen. We successfully developed early prediction models of new-onset functional impairment after ICU admission that achieved high performance using only data routinely collected within 2 days of ICU admission.
Identifiants
pubmed: 35362765
doi: 10.1007/s00134-022-06688-z
pii: 10.1007/s00134-022-06688-z
doi:
Types de publication
Journal Article
Multicenter Study
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
679-689Subventions
Organisme : Ministry of Health, Labour and Welfare
ID : 21AA2007
Organisme : Ministry of Health, Labour and Welfare
ID : 20AA2005
Organisme : Ministry of Education, Culture, Sports, Science and Technology
ID : 20H03907
Commentaires et corrections
Type : CommentIn
Type : CommentIn
Informations de copyright
© 2022. Springer-Verlag GmbH Germany, part of Springer Nature.
Références
Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H et al (2012) Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med 40(2):502–509. https://doi.org/10.1097/CCM.0b013e318232da75
doi: 10.1097/CCM.0b013e318232da75
pubmed: 21946660
Ingraham NE, Vakayil V, Pendleton KM, Robbins AJ, Freese RL, Northrop EF et al (2020) National trends and variation of functional status deterioration in the medically critically ill. Crit Care Med 48(11):1556–1564. https://doi.org/10.1097/CCM.0000000000004524
doi: 10.1097/CCM.0000000000004524
pubmed: 32886469
pmcid: 8033631
Chelluri L, Pinsky MR, Donahoe MP, Grenvik A (1993) Long-term outcome of critically ill elderly patients requiring intensive care. JAMA 269(24):3119–3123. https://doi.org/10.1001/jama.269.24.3119
doi: 10.1001/jama.269.24.3119
pubmed: 8505814
Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794. https://doi.org/10.1001/jama.2010.1553
doi: 10.1001/jama.2010.1553
pubmed: 20978258
pmcid: 3345288
Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F et al (2003) One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med 348(8):683–693. https://doi.org/10.1056/NEJMoa022450
doi: 10.1056/NEJMoa022450
pubmed: 12594312
Dowdy DW, Eid MP, Sedrakyan A, Mendez-Tellez PA, Pronovost PJ, Herridge MS, Needham DM (2005) Quality of life in adult survivors of critical illness: a systematic review of the literature. Intensive Care Med 31(5):611–620. https://doi.org/10.1007/s00134-005-2592-6
doi: 10.1007/s00134-005-2592-6
pubmed: 15803303
Ferrante LE, Pisani MA, Murphy TE, Gahbauer EA, Leo-Summers LS, Gill TM (2015) Functional trajectories among older persons before and after critical illness. JAMA Intern Med 175(4):523–529. https://doi.org/10.1001/jamainternmed.2014.7889
doi: 10.1001/jamainternmed.2014.7889
pubmed: 25665067
pmcid: 4467795
Harvey MA, Davidson JE (2016) Postintensive care syndrome: right care, right now…and later. Crit Care Med 44(2):381–385. https://doi.org/10.1097/CCM.0000000000001531
doi: 10.1097/CCM.0000000000001531
pubmed: 26771784
Inoue S, Hatakeyama J, Kondo Y, Hifumi T, Sakuramoto H, Kawasaki T et al (2019) Post-intensive care syndrome: its pathophysiology, prevention, and future directions. Acute Med Surg 6(3):233–246. https://doi.org/10.1002/ams2.415
doi: 10.1002/ams2.415
pubmed: 31304024
pmcid: 6603316
Turnbull AE, Davis WE, Needham DM, White DB, Eakin MN (2016) Intensivist-reported facilitators and barriers to discussing post-discharge outcomes with Intensive Care Unit surrogates. A qualitative study. Ann Am Thorac Soc 13(9):1546–1552. https://doi.org/10.1513/AnnalsATS.201603-212OC
doi: 10.1513/AnnalsATS.201603-212OC
pubmed: 27294981
pmcid: 5059504
Schandl A, Bottai M, Holdar U, Hellgren E, Sackey P (2014) Early prediction of new-onset physical disability after intensive care unit stay: a preliminary instrument. Crit Care 18(4):455. https://doi.org/10.1186/s13054-014-0455-7
doi: 10.1186/s13054-014-0455-7
pubmed: 25079385
pmcid: 4243809
Oeyen S, Vermeulen K, Benoit D, Annemans L, Decruyenaere J (2018) Development of a prediction model for long-term quality of life in critically ill patients. J Crit Care 43:133–138. https://doi.org/10.1016/j.jcrc.2017.09.006
doi: 10.1016/j.jcrc.2017.09.006
pubmed: 28892669
Detsky ME, Harhay MO, Bayard DF, Delman AM, Buehler AE, Kent SA et al (2017) Six-month morbidity and mortality among intensive care unit patients receiving life-sustaining therapy. A prospective cohort study. Ann Am Thorac Soc 14(10):1562–1570. https://doi.org/10.1513/AnnalsATS.201611-875OC
doi: 10.1513/AnnalsATS.201611-875OC
pubmed: 28622004
pmcid: 5718567
Higgins AM, Neto AS, Bailey M, Barrett J, Bellomo R, Cooper DJ et al (2021) Predictors of death and new disability after critical illness: a multicentre prospective cohort study. Intensive Care Med 47(7):772–781. https://doi.org/10.1007/s00134-021-06438-7
doi: 10.1007/s00134-021-06438-7
pubmed: 34089063
Wubben N, van den Boogaard M, Ramjith J, Bisschops LLA, Frenzel T, van der Hoeven JG, Zegers M (2021) Development of a practically usable prediction model for quality of life of ICU survivors: a sub-analysis of the MONITOR-IC prospective cohort study. J Crit Care 65:76–83. https://doi.org/10.1016/j.jcrc.2021.04.019
doi: 10.1016/j.jcrc.2021.04.019
pubmed: 34111683
Haines KJ, Hibbert E, McPeake J, Anderson BJ, Bienvenu OJ, Andrews A et al (2020) Prediction models for physical, cognitive, and mental health impairments after critical illness: a systematic review and critical appraisal. Crit Care Med 48(12):1871–1880. https://doi.org/10.1097/CCM.0000000000004659
doi: 10.1097/CCM.0000000000004659
pubmed: 33060502
pmcid: 7673641
Taniguchi Y, Kuno T, Komiyama J, Adomi M, Suzuki T, Abe T et al (2022) Comparison of patient characteristics and in-hospital mortality between patients with COVID-19 in 2020 and those with influenza in 2017–2020: a multicenter, retrospective cohort study in Japan. Lancet Reg Health West Pac 20:100365. https://doi.org/10.1016/j.lanwpc.2021.100365
doi: 10.1016/j.lanwpc.2021.100365
pubmed: 35005672
pmcid: 8720491
Miyawaki A, Tomio J, Nakamura M, Ninomiya H, Kobayashi Y (2021) Changes in surgeries and therapeutic procedures during the COVID-19 outbreak: a longitudinal study of acute care hospitals in Japan. Ann Surg 273(4):e132–e134. https://doi.org/10.1097/SLA.0000000000004528
doi: 10.1097/SLA.0000000000004528
pubmed: 33214438
Collins GS, Reitsma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Surg 102(3):148–158. https://doi.org/10.1002/bjs.9736
doi: 10.1002/bjs.9736
pubmed: 25627261
Ohbe H, Sasabuchi Y, Kumazawa R, Matsui H, Yasunaga H (2021) Intensive care unit occupancy in Japan, 2015–2018: a nationwide inpatient database study. J Epidemiol. https://doi.org/10.2188/jea.JE20210016
doi: 10.2188/jea.JE20210016
pubmed: 33840654
pmcid: 7878706
Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA (2004) New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol 57(12):1288–1294. https://doi.org/10.1016/j.jclinepi.2004.03.012
doi: 10.1016/j.jclinepi.2004.03.012
pubmed: 15617955
Irie H, Okamoto H, Uchino S, Endo H, Uchida M, Kawasaki T et al (2020) The Japanese Intensive care PAtient Database (JIPAD): a national intensive care unit registry in Japan. J Crit Care 55:86–94. https://doi.org/10.1016/j.jcrc.2019.09.004
doi: 10.1016/j.jcrc.2019.09.004
pubmed: 31715536
Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H et al (1996) The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 22(7):707–710. https://doi.org/10.1007/BF01709751
doi: 10.1007/BF01709751
pubmed: 8844239
Yamana H, Moriwaki M, Horiguchi H, Kodan M, Fushimi K, Yasunaga H (2017) Validity of diagnoses, procedures, and laboratory data in Japanese administrative data. J Epidemiol 27(10):476–482. https://doi.org/10.1016/j.je.2016.09.009
doi: 10.1016/j.je.2016.09.009
pubmed: 28142051
pmcid: 5602797
Schweickert WD, Pohlman MC, Pohlman AS, Nigos C, Pawlik AJ, Esbrook CL et al (2009) Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet 373(9678):1874–1882. https://doi.org/10.1016/S0140-6736(09)60658-9
doi: 10.1016/S0140-6736(09)60658-9
pubmed: 19446324
Scheffenbichler FT, Teja B, Wongtangman K, Mazwi N, Waak K, Schaller SJ et al (2021) Effects of the level and duration of mobilization therapy in the surgical ICU on the loss of the ability to live independently: an international prospective cohort study. Crit Care Med 49(3):e247–e257. https://doi.org/10.1097/CCM.0000000000004808
doi: 10.1097/CCM.0000000000004808
pubmed: 33416257
pmcid: 7902391
Mahoney FI, Barthel DW (1965) Functional evaluation: the Barthel index. Md State Med J 14:61–65
pubmed: 14258950
Guyatt GH, Deyo RA, Charlson M, Levine MN, Mitchell A (1989) Responsiveness and validity in health status measurement: a clarification. J Clin Epidemiol 42(5):403–408. https://doi.org/10.1016/0895-4356(89)90128-5
doi: 10.1016/0895-4356(89)90128-5
pubmed: 2659745
Uyttenboogaart M, Stewart RE, Vroomen PCAJ, De Keyser J, Luijckx GJ (2005) Optimizing cutoff scores for the Barthel index and the modified Rankin scale for defining outcome in acute stroke trials. Stroke 36(9):1984–1987. https://doi.org/10.1161/01.STR.0000177872.87960.61
doi: 10.1161/01.STR.0000177872.87960.61
pubmed: 16081854
Austin PC, van Klaveren D, Vergouwe Y, Nieboer D, Lee DS, Steyerberg EW (2016) Geographic and temporal validity of prediction models: different approaches were useful to examine model performance. J Clin Epidemiol 79:76–85. https://doi.org/10.1016/j.jclinepi.2016.05.007
doi: 10.1016/j.jclinepi.2016.05.007
pubmed: 27262237
pmcid: 5708595
Saar-Tsechansky M, Provost F (2007) Handling missing values when applying classification models. J Mach Learn Res 8:1625–1657
Kuhn M (2022) The caret package. https://topepo.github.io/caret/ . Accessed 3 Jan 2022
Beam AL, Kohane IS (2018) Big data and machine learning in health care. JAMA 319(13):1317–1318. https://doi.org/10.1001/jama.2017.18391
doi: 10.1001/jama.2017.18391
pubmed: 29532063
Steyerberg EW (2018) Validation in prediction research: the waste by data splitting. J Clin Epidemiol 103:131–133. https://doi.org/10.1016/j.jclinepi.2018.07.010
doi: 10.1016/j.jclinepi.2018.07.010
pubmed: 30063954
varImp function—RDocumentation. https://www.rdocumentation.org/packages/caret/versions/6.0-90/topics/varImp Accessed 3 Jan 2022
Mikkelsen ME, Still M, Anderson BJ, Bienvenu OJ, Brodsky MB, Brummel N et al (2020) Society of Critical Care Medicine’s international consensus conference on prediction and identification of long-term impairments after critical illness. Crit Care Med 48(11):1670–1679. https://doi.org/10.1097/CCM.0000000000004586
doi: 10.1097/CCM.0000000000004586
pubmed: 32947467
Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS et al (2019) PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med 170(1):51–58. https://doi.org/10.7326/M18-1376
doi: 10.7326/M18-1376
pubmed: 30596875
Sturm JW, Dewey HM, Donnan GA, Macdonell RAL, McNeil JJ, Thrift AG (2002) Handicap after stroke: how does it relate to disability, perception of recovery, and stroke subtype?: the north North East Melbourne Stroke Incidence Study (NEMESIS). Stroke 33(3):762–768. https://doi.org/10.1161/hs0302.103815
doi: 10.1161/hs0302.103815
pubmed: 11872901
van der Vorst A, Zijlstra GAR, Witte ND, Duppen D, Stuck AE, Kempen GIJM et al (2016) Limitations in activities of daily living in community-dwelling people aged 75 and over: a systematic literature review of risk and protective factors. PLoS ONE 11(10):e0165127. https://doi.org/10.1371/journal.pone.0165127
doi: 10.1371/journal.pone.0165127
pubmed: 27760234
pmcid: 5070862
Nicholson JP, Wolmarans MR, Park GR (2000) The role of albumin in critical illness. Br J Anaesth 85(4):599–610. https://doi.org/10.1093/bja/85.4.599
doi: 10.1093/bja/85.4.599
pubmed: 11064620
Haines RW, Zolfaghari P, Wan Y, Pearse RM, Puthucheary Z, Prowle JR (2019) Elevated urea-to-creatinine ratio provides a biochemical signature of muscle catabolism and persistent critical illness after major trauma. Intensive Care Med 45(12):1718–1731. https://doi.org/10.1007/s00134-019-05760-5
doi: 10.1007/s00134-019-05760-5
pubmed: 31531715
Gentile LF, Cuenca AG, Efron PA, Ang D, Bihorac A, McKinley BA et al (2012) Persistent inflammation and immunosuppression: a common syndrome and new horizon for surgical intensive care. J Trauma Acute Care Surg 72(6):1491–1501. https://doi.org/10.1097/TA.0b013e318256e000
doi: 10.1097/TA.0b013e318256e000
pubmed: 22695412
pmcid: 3705923
Azoulay E, Kentish-Barnes N, Pochard F (2008) Health-related quality of life: an outcome variable in critical care survivors. Chest 133(2):339–341. https://doi.org/10.1378/chest.07-2547
doi: 10.1378/chest.07-2547
pubmed: 18252911
Govindan S, Iwashyna TJ, Watson SR, Hyzy RC, Miller MA (2014) Issues of survivorship are rarely addressed during intensive care unit stays. Baseline results from a statewide quality improvement collaborative. Ann Am Thorac Soc 11(4):587–591. https://doi.org/10.1513/AnnalsATS.201401-007BC
doi: 10.1513/AnnalsATS.201401-007BC
pubmed: 24605936
pmcid: 4225798
van Zanten ARH, De Waele E, Wischmeyer PE (2019) Nutrition therapy and critical illness: practical guidance for the ICU, post-ICU, and long-term convalescence phases. Crit Care 23(1):368. https://doi.org/10.1186/s13054-019-2657-5
doi: 10.1186/s13054-019-2657-5
pubmed: 31752979
pmcid: 6873712
Vollmer S, Mateen BA, Bohner G, Király FJ, Ghani R, Jonsson P et al (2020) Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 368:l6927. https://doi.org/10.1136/bmj.l6927
doi: 10.1136/bmj.l6927
pubmed: 32198138
Collins GS, Dhiman P, Andaur Navarro CL, Ma J, Hooft L, Reitsma JB et al (2021) Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open 11(7):e048008. https://doi.org/10.1136/bmjopen-2020-048008
doi: 10.1136/bmjopen-2020-048008
pubmed: 34244270
pmcid: 8273461
Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B (2019) A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol 110:12–22. https://doi.org/10.1016/j.jclinepi.2019.02.004
doi: 10.1016/j.jclinepi.2019.02.004
pubmed: 30763612
Uemura Y, Shibata R, Takemoto K, Koyasu M, Ishikawa S, Murohara T, Watarai M (2018) Prognostic impact of the preservation of activities of daily living on post-discharge outcomes in patients with acute heart failure. Circ J 82(11):2793–2799. https://doi.org/10.1253/circj.CJ-18-0279
doi: 10.1253/circj.CJ-18-0279
pubmed: 30158344
Sato M, Mutai H, Yamamoto S, Tsukakoshi D, Takeda S, Oguchi N et al (2021) Decreased activities of daily living at discharge predict mortality and readmission in elderly patients after cardiac and aortic surgery: a retrospective cohort study. Medicine (Baltimore) 100(31):e26819. https://doi.org/10.1097/MD.0000000000026819
doi: 10.1097/MD.0000000000026819