A machine-learning parsimonious multivariable predictive model of mortality risk in patients with Covid-19.
Aged
Aged, 80 and over
Blood Cell Count
Blood Chemical Analysis
COVID-19
/ blood
Cohort Studies
Female
Hospital Mortality
Humans
Machine Learning
Male
Middle Aged
Models, Statistical
Multivariate Analysis
Oxygen
/ blood
Pandemics
/ statistics & numerical data
ROC Curve
Risk Factors
Rome
/ epidemiology
SARS-CoV-2
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
27 10 2021
27 10 2021
Historique:
received:
20
05
2021
accepted:
02
09
2021
entrez:
28
10
2021
pubmed:
29
10
2021
medline:
5
11
2021
Statut:
epublish
Résumé
The COVID-19 pandemic is impressively challenging the healthcare system. Several prognostic models have been validated but few of them are implemented in daily practice. The objective of the study was to validate a machine-learning risk prediction model using easy-to-obtain parameters to help to identify patients with COVID-19 who are at higher risk of death. The training cohort included all patients admitted to Fondazione Policlinico Gemelli with COVID-19 from March 5, 2020, to November 5, 2020. Afterward, the model was tested on all patients admitted to the same hospital with COVID-19 from November 6, 2020, to February 5, 2021. The primary outcome was in-hospital case-fatality risk. The out-of-sample performance of the model was estimated from the training set in terms of Area under the Receiving Operator Curve (AUROC) and classification matrix statistics by averaging the results of fivefold cross validation repeated 3-times and comparing the results with those obtained on the test set. An explanation analysis of the model, based on the SHapley Additive exPlanations (SHAP), is also presented. To assess the subsequent time evolution, the change in paO2/FiO2 (P/F) at 48 h after the baseline measurement was plotted against its baseline value. Among the 921 patients included in the training cohort, 120 died (13%). Variables selected for the model were age, platelet count, SpO2, blood urea nitrogen (BUN), hemoglobin, C-reactive protein, neutrophil count, and sodium. The results of the fivefold cross-validation repeated 3-times gave AUROC of 0.87, and statistics of the classification matrix to the Youden index as follows: sensitivity 0.840, specificity 0.774, negative predictive value 0.971. Then, the model was tested on a new population (n = 1463) in which the case-fatality rate was 22.6%. The test model showed AUROC 0.818, sensitivity 0.813, specificity 0.650, negative predictive value 0.922. Considering the first quartile of the predicted risk score (low-risk score group), the case-fatality rate was 1.6%, 17.8% in the second and third quartile (high-risk score group) and 53.5% in the fourth quartile (very high-risk score group). The three risk score groups showed good discrimination for the P/F value at admission, and a positive correlation was found for the low-risk class to P/F at 48 h after admission (adjusted R-squared = 0.48). We developed a predictive model of death for people with SARS-CoV-2 infection by including only easy-to-obtain variables (abnormal blood count, BUN, C-reactive protein, sodium and lower SpO2). It demonstrated good accuracy and high power of discrimination. The simplicity of the model makes the risk prediction applicable for patients in the Emergency Department, or during hospitalization. Although it is reasonable to assume that the model is also applicable in not-hospitalized persons, only appropriate studies can assess the accuracy of the model also for persons at home.
Identifiants
pubmed: 34707184
doi: 10.1038/s41598-021-99905-6
pii: 10.1038/s41598-021-99905-6
pmc: PMC8551240
doi:
Substances chimiques
Oxygen
S88TT14065
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
21136Investigateurs
Alessandro Armuzzi
(A)
Marta Barba
(M)
Silvia Baroni
(S)
Silvia Bellesi
(S)
Annarita Bentivoglio
(A)
Luigi Marzio Biasucci
(LM)
Federico Biscetti
(F)
Marcello Candelli
(M)
Gennaro Capalbo
(G)
Paola Cattani
(P)
Patrizia Chiusolo
(P)
Antonella Cingolani
(A)
Giuseppe Corbo
(G)
Marcello Covino
(M)
Angela Maria Cozzolino
(AM)
Marilena D'Alfonso
(M)
Giulia De Angelis
(G)
Gennaro De Pascale
(G)
Giovanni Frisullo
(G)
Maurizio Gabrielli
(M)
Giovanni Gambassi
(G)
Matteo Garcovich
(M)
Elisa Gremese
(E)
Domenico Luca Grieco
(DL)
Amerigo Iaconelli
(A)
Raffaele Iorio
(R)
Francesco Landi
(F)
Annarita Larici
(A)
Giovanna Liuzzo
(G)
Riccardo Maviglia
(R)
Luca Miele
(L)
Massimo Montalto
(M)
Luigi Natale
(L)
Nicola Nicolotti
(N)
Veronica Ojetti
(V)
Maurizio Pompili
(M)
Brunella Posteraro
(B)
Gianni Rapaccini
(G)
Riccardo Rinaldi
(R)
Elena Rossi
(E)
Angelo Santoliquido
(A)
Simona Sica
(S)
Enrica Tamburrini
(E)
Luciana Teofili
(L)
Antonia Testa
(A)
Alberto Tosoni
(A)
Carlo Trani
(C)
Francesco Varone
(F)
Lorenzo Zileri Dal Verme
(LZD)
Informations de copyright
© 2021. The Author(s).
Références
JAMA Netw Open. 2020 Oct 1;3(10):e2023934
pubmed: 33125498
Clin Microbiol Infect. 2020 Nov;26(11):1525-1536
pubmed: 32758659
Front Genet. 2021 May 20;12:636441
pubmed: 34093642
Thorax. 2003 May;58(5):377-82
pubmed: 12728155
Mod Pathol. 2021 Mar;34(3):522-531
pubmed: 33067522
BMJ. 2020 Apr 7;369:m1328
pubmed: 32265220
Sci Rep. 2021 Feb 8;11(1):3343
pubmed: 33558602
medRxiv. 2021 Jul 23;:
pubmed: 34341796
JAMA. 2020 Apr 7;323(13):1239-1242
pubmed: 32091533
Sci Rep. 2021 Feb 5;11(1):3246
pubmed: 33547335
JAMA. 2017 Jan 17;317(3):290-300
pubmed: 28114553
PeerJ. 2020 Sep 28;8:e10083
pubmed: 33062451
N Engl J Med. 2020 Apr 30;382(18):1708-1720
pubmed: 32109013
JAMA Intern Med. 2020 Aug 1;180(8):1081-1089
pubmed: 32396163
Crit Care. 2021 Feb 15;25(1):63
pubmed: 33588914
Lancet. 2020 Mar 28;395(10229):1054-1062
pubmed: 32171076
JAMA Intern Med. 2021 Apr 1;181(4):471-478
pubmed: 33351068
BMJ. 2020 Mar 26;368:m1091
pubmed: 32217556
J Med Internet Res. 2020 Nov 11;22(11):e23128
pubmed: 33035175
Comput Biol Med. 2021 Jul;134:104531
pubmed: 34091385
NPJ Digit Med. 2020 Oct 6;3:130
pubmed: 33083565
Clin Chem Lab Med. 2020 Jun 25;58(7):1021-1028
pubmed: 32286245
JAMA Intern Med. 2020 Nov 1;180(11):1436-1447
pubmed: 32667668
Cognit Comput. 2021 Apr 21;:1-16
pubmed: 33897907
Am J Med Sci. 2021 Oct;362(4):355-362
pubmed: 34029558
J Transl Med. 2021 Feb 5;19(1):56
pubmed: 33546711
NPJ Digit Med. 2021 May 21;4(1):87
pubmed: 34021235
BMJ. 2020 Sep 9;370:m3339
pubmed: 32907855