Automated APACHE II and SOFA score calculation using real-world electronic medical record data in a single center.
APACHE II score
Acuity
Automation
Critical care
Triaging
Journal
Journal of clinical monitoring and computing
ISSN: 1573-2614
Titre abrégé: J Clin Monit Comput
Pays: Netherlands
ID NLM: 9806357
Informations de publication
Date de publication:
08 2023
08 2023
Historique:
received:
18
01
2023
accepted:
01
04
2023
medline:
28
7
2023
pubmed:
19
4
2023
entrez:
19
04
2023
Statut:
ppublish
Résumé
The integration of illness severity and organ dysfunction scores into clinical practice, including the APACHE II and SOFA scores, has been challenging due to constraints associated to manual score calculation. With electronic medical records (EMR), score calculation automation using data extraction scripts has emerged as a solution. We aimed to demonstrate that APACHE II and SOFA scores calculated with an automated EMR-based data extraction script predict important clinical endpoints. In this retrospective cohort study, every adult patient admitted to one of our three ICUs, between July 1, 2019, and December 31, 2020, were enrolled. For every patient, an automated ICU admission APACHE II score was calculated using EMR data and minimal clinician input. Fully automated daily SOFA scores were calculated for every patient. 4 794 ICU admissions met our selection criteria. Of these ICU admissions, 522 deaths were recorded (10.9% in-hospital mortality rate). The automated APACHE II was discriminant for in-hospital mortality (AU-ROC = 0.83 (95% CI 0.81-0.85)). We observed an association between the APACHE II score and ICU LOS, with a statistically significant mean increase of 1.1 days of ICU LOS (1.1 [1-1.2]; p = < .0001) for each 10 units increase in APACHE score. SOFA score curves did not discrimate significantly between survivors and non-survivors. A partially automated APACHE II score, calculated with real-world EMR data using an extraction script, is associated with in-hospital mortality risk. The automated APACHE II score could potentially constitute an acceptable surrogate of ICU acuity to be used in resource allocation and triaging, especially in time of high demand for ICU beds.
Identifiants
pubmed: 37074523
doi: 10.1007/s10877-023-01010-8
pii: 10.1007/s10877-023-01010-8
pmc: PMC10113718
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1023-1033Informations de copyright
© 2023. The Author(s), under exclusive licence to Springer Nature B.V.
Références
Breslow MJ, Badawi O. Severity scoring in the critically Ill Part 2: maximizing value from outcome prediction scoring systems. Chest. 2012;141(2):518–27.
doi: 10.1378/chest.11-0331
pubmed: 22315120
Polderman KH, Girbes ARJ, Thijs LG, Strack van Schijndel RJM. Accuracy and reliability of APACHE II scoring in two intensive care units: problems and pitfalls in the use of APACHE II and suggestions for improvement. Anaesthesia. 2001;56:47–50.
doi: 10.1046/j.1365-2044.2001.01763.x
pubmed: 11167435
Gooder VJ, Farr BR et Young MP. Accuracy and Efficiency of an Automated System for Calculating APACHE II Scores in an Intensive Care Unit. Proc AMIA Annu Fall Symp, 1997, p.131–135.
Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–29.
doi: 10.1097/00003246-198510000-00009
pubmed: 3928249
Junger A, Böttger S, Engel J, Benson M, Michel A, Röhrig R, Jost A, Hempelmann G. Automatic calculation of a modified APACHE II score using patient data management system (PDMS). Int J Med Informatics. 2002;65:145–57.
doi: 10.1016/S1386-5056(02)00014-X
Quach S, Hennessy DA, Faris P, Fong A, Quan H, Doig C. A comparison between the APACHE II and Charlson Index Score for predicting hospital mortality in critically ill patients. BMC Health Serv Res. 2009;9:129.
doi: 10.1186/1472-6963-9-129
pubmed: 19643010
pmcid: 2731744
Vincent JL, De Mendonça A, Cantraine F, Moreno R, Takala J, Suter PM, Sprung CL, Colardyn F, Blecher S. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Crit Care Med. 1998;26(11):1793–800.
doi: 10.1097/00003246-199811000-00016
pubmed: 9824069
Huerta LE, Wanderer JP, Ehrenfeld JM, Freundlich RE, Rice TW, Semler MW. Validation of a sequential organ failure assessment score using electronic health record data. J Med Syst. 2018;42:199. https://doi.org/10.1007/s10916-018-1060-0 .
doi: 10.1007/s10916-018-1060-0
pubmed: 30218383
pmcid: 6261278
Shickel B, Loftus TJ, Adhikari L, Ozrazgat-Baslanti T, Bihorac A, Rashidi P. A continuous acuity score for critically Ill patients using clinically interpretable deep learning. scientific report. Scie Rep. 2019;9:1879. https://doi.org/10.1038/s41598-019-38491-0 .
doi: 10.1038/s41598-019-38491-0
Trudelle N, Ferrari N. Indicateurs de qualité pour soutenir une organisation de service optimale en soins intensifs au Québec. INESSS, 2018, p.1–67
Chornenski NJ, Liaw P, Bagshaw S, Burns K, Dodek P, English S, Fan E, Ferrari N, Fowler R, Fox-Robichaud A, Garland A, Green R, Hebert P, Kho M, Martin C, Maslove D, McDonald E, Menon K, Murthy S, Muscedere J, Scales D, Stelfox HT, Wang HT, Weiss M. Data initiatives supporting care research and quality improvement in Canada: an environmental scan and narrative review. Can J Anesth. 2020;67:475–84.
doi: 10.1007/s12630-020-01571-1
Carter JV, Pan J, Rai SN, Galandiuk S. ROC-ing along: evaluation and interpretation of receiver operating characteristic curves. Surgery. 2016;159(6):1638–45.
doi: 10.1016/j.surg.2015.12.029
pubmed: 26962006
Priestap F, Kao R, Martin CM. External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System. Can J Anaesth. 2020;67(8):981–91.
doi: 10.1007/s12630-020-01686-5
pubmed: 32383124
pmcid: 7223438
Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991;100:1619–36.
doi: 10.1378/chest.100.6.1619
pubmed: 1959406
Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med. 2006;34(5):1297–310.
doi: 10.1097/01.CCM.0000215112.84523.F0
pubmed: 16540951
Zou X, Li S, Fang M, Hu M, Bian Y, Ling J, Yu S, Jing L, Li D, Huang J. Acute physiology and chronic health evaluation II score as a predictor of hospital mortality in patients of Coronavirus disease 2019. Crit Care Med. 2020;48(8):e657–65.
doi: 10.1097/CCM.0000000000004411
pubmed: 32697506
pmcid: 7217128
Rees EM, Nightingale ES, Jafari Y, Waterlow NR, Clifford S, Pearson CAB, CMMID Working Group, Jombart T, Procter SR, Knight GM. COVID-19 length of hospital stay: a systematic review and data synthesis. BMC Med. 2020;18:270.
doi: 10.1186/s12916-020-01726-3
pubmed: 32878619
pmcid: 7467845
Gershengom HB, Patel S, Shukla B, Warde PR, Soorus SM, Holt GE, Kett DN, Parekh DJ, Ferreira T. Predictive value of sequential organ failure assessment score across patients with and without COVID-19 infection. Ann Am Thorac Soc. 2002;19(5):790–8.
doi: 10.1513/AnnalsATS.202106-680OC
Polderman KH, Jorna EM, Girbes AR. Inter-observer variability in APACHE II scoring: effect of strict guidelines and training. Intensive Care Med. 2001;27(8):1365–9.
doi: 10.1007/s001340101012
pubmed: 11511950
Polderman KH, Christiaans HM, Wester JP, Spijkstra JJ, Girbes AR. Intra-observer variability in APACHE II scoring. Intensive Care Med. 2001;27(9):1550–2.
doi: 10.1007/s001340101033
pubmed: 11685351