A machine-learning parsimonious multivariable predictive model of mortality risk in patients with Covid-19.


Journal

Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288

Informations de publication

Date de publication:
27 10 2021
Historique:
received: 20 05 2021
accepted: 02 09 2021
entrez: 28 10 2021
pubmed: 29 10 2021
medline: 5 11 2021
Statut: epublish

Résumé

The COVID-19 pandemic is impressively challenging the healthcare system. Several prognostic models have been validated but few of them are implemented in daily practice. The objective of the study was to validate a machine-learning risk prediction model using easy-to-obtain parameters to help to identify patients with COVID-19 who are at higher risk of death. The training cohort included all patients admitted to Fondazione Policlinico Gemelli with COVID-19 from March 5, 2020, to November 5, 2020. Afterward, the model was tested on all patients admitted to the same hospital with COVID-19 from November 6, 2020, to February 5, 2021. The primary outcome was in-hospital case-fatality risk. The out-of-sample performance of the model was estimated from the training set in terms of Area under the Receiving Operator Curve (AUROC) and classification matrix statistics by averaging the results of fivefold cross validation repeated 3-times and comparing the results with those obtained on the test set. An explanation analysis of the model, based on the SHapley Additive exPlanations (SHAP), is also presented. To assess the subsequent time evolution, the change in paO2/FiO2 (P/F) at 48 h after the baseline measurement was plotted against its baseline value. Among the 921 patients included in the training cohort, 120 died (13%). Variables selected for the model were age, platelet count, SpO2, blood urea nitrogen (BUN), hemoglobin, C-reactive protein, neutrophil count, and sodium. The results of the fivefold cross-validation repeated 3-times gave AUROC of 0.87, and statistics of the classification matrix to the Youden index as follows: sensitivity 0.840, specificity 0.774, negative predictive value 0.971. Then, the model was tested on a new population (n = 1463) in which the case-fatality rate was 22.6%. The test model showed AUROC 0.818, sensitivity 0.813, specificity 0.650, negative predictive value 0.922. Considering the first quartile of the predicted risk score (low-risk score group), the case-fatality rate was 1.6%, 17.8% in the second and third quartile (high-risk score group) and 53.5% in the fourth quartile (very high-risk score group). The three risk score groups showed good discrimination for the P/F value at admission, and a positive correlation was found for the low-risk class to P/F at 48 h after admission (adjusted R-squared = 0.48). We developed a predictive model of death for people with SARS-CoV-2 infection by including only easy-to-obtain variables (abnormal blood count, BUN, C-reactive protein, sodium and lower SpO2). It demonstrated good accuracy and high power of discrimination. The simplicity of the model makes the risk prediction applicable for patients in the Emergency Department, or during hospitalization. Although it is reasonable to assume that the model is also applicable in not-hospitalized persons, only appropriate studies can assess the accuracy of the model also for persons at home.

Identifiants

pubmed: 34707184
doi: 10.1038/s41598-021-99905-6
pii: 10.1038/s41598-021-99905-6
pmc: PMC8551240
doi:

Substances chimiques

Oxygen S88TT14065

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

21136

Investigateurs

Alessandro Armuzzi (A)
Marta Barba (M)
Silvia Baroni (S)
Silvia Bellesi (S)
Annarita Bentivoglio (A)
Luigi Marzio Biasucci (LM)
Federico Biscetti (F)
Marcello Candelli (M)
Gennaro Capalbo (G)
Paola Cattani (P)
Patrizia Chiusolo (P)
Antonella Cingolani (A)
Giuseppe Corbo (G)
Marcello Covino (M)
Angela Maria Cozzolino (AM)
Marilena D'Alfonso (M)
Giulia De Angelis (G)
Gennaro De Pascale (G)
Giovanni Frisullo (G)
Maurizio Gabrielli (M)
Giovanni Gambassi (G)
Matteo Garcovich (M)
Elisa Gremese (E)
Domenico Luca Grieco (DL)
Amerigo Iaconelli (A)
Raffaele Iorio (R)
Francesco Landi (F)
Annarita Larici (A)
Giovanna Liuzzo (G)
Riccardo Maviglia (R)
Luca Miele (L)
Massimo Montalto (M)
Luigi Natale (L)
Nicola Nicolotti (N)
Veronica Ojetti (V)
Maurizio Pompili (M)
Brunella Posteraro (B)
Gianni Rapaccini (G)
Riccardo Rinaldi (R)
Elena Rossi (E)
Angelo Santoliquido (A)
Simona Sica (S)
Enrica Tamburrini (E)
Luciana Teofili (L)
Antonia Testa (A)
Alberto Tosoni (A)
Carlo Trani (C)
Francesco Varone (F)
Lorenzo Zileri Dal Verme (LZD)

Informations de copyright

© 2021. The Author(s).

Références

JAMA Netw Open. 2020 Oct 1;3(10):e2023934
pubmed: 33125498
Clin Microbiol Infect. 2020 Nov;26(11):1525-1536
pubmed: 32758659
Front Genet. 2021 May 20;12:636441
pubmed: 34093642
Thorax. 2003 May;58(5):377-82
pubmed: 12728155
Mod Pathol. 2021 Mar;34(3):522-531
pubmed: 33067522
BMJ. 2020 Apr 7;369:m1328
pubmed: 32265220
Sci Rep. 2021 Feb 8;11(1):3343
pubmed: 33558602
medRxiv. 2021 Jul 23;:
pubmed: 34341796
JAMA. 2020 Apr 7;323(13):1239-1242
pubmed: 32091533
Sci Rep. 2021 Feb 5;11(1):3246
pubmed: 33547335
JAMA. 2017 Jan 17;317(3):290-300
pubmed: 28114553
PeerJ. 2020 Sep 28;8:e10083
pubmed: 33062451
N Engl J Med. 2020 Apr 30;382(18):1708-1720
pubmed: 32109013
JAMA Intern Med. 2020 Aug 1;180(8):1081-1089
pubmed: 32396163
Crit Care. 2021 Feb 15;25(1):63
pubmed: 33588914
Lancet. 2020 Mar 28;395(10229):1054-1062
pubmed: 32171076
JAMA Intern Med. 2021 Apr 1;181(4):471-478
pubmed: 33351068
BMJ. 2020 Mar 26;368:m1091
pubmed: 32217556
J Med Internet Res. 2020 Nov 11;22(11):e23128
pubmed: 33035175
Comput Biol Med. 2021 Jul;134:104531
pubmed: 34091385
NPJ Digit Med. 2020 Oct 6;3:130
pubmed: 33083565
Clin Chem Lab Med. 2020 Jun 25;58(7):1021-1028
pubmed: 32286245
JAMA Intern Med. 2020 Nov 1;180(11):1436-1447
pubmed: 32667668
Cognit Comput. 2021 Apr 21;:1-16
pubmed: 33897907
Am J Med Sci. 2021 Oct;362(4):355-362
pubmed: 34029558
J Transl Med. 2021 Feb 5;19(1):56
pubmed: 33546711
NPJ Digit Med. 2021 May 21;4(1):87
pubmed: 34021235
BMJ. 2020 Sep 9;370:m3339
pubmed: 32907855

Auteurs

Rita Murri (R)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy. rita.murri@policlinicogemelli.it.

Jacopo Lenkowicz (J)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Carlotta Masciocchi (C)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Chiara Iacomini (C)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Massimo Fantoni (M)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Andrea Damiani (A)

Università Cattolica Sacro Cuore, Rome, Italy.

Antonio Marchetti (A)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Paolo Domenico Angelo Sergi (PDA)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Giovanni Arcuri (G)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Alfredo Cesario (A)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Stefano Patarnello (S)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Massimo Antonelli (M)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Rocco Bellantone (R)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Roberto Bernabei (R)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Stefania Boccia (S)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Paolo Calabresi (P)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Andrea Cambieri (A)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Roberto Cauda (R)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Cesare Colosimo (C)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Filippo Crea (F)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Ruggero De Maria (R)

Università Cattolica Sacro Cuore, Rome, Italy.

Valerio De Stefano (V)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Francesco Franceschi (F)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Antonio Gasbarrini (A)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Ornella Parolini (O)

Università Cattolica Sacro Cuore, Rome, Italy.

Luca Richeldi (L)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Maurizio Sanguinetti (M)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Andrea Urbani (A)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Maurizio Zega (M)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Giovanni Scambia (G)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Vincenzo Valentini (V)

Sezione di Malattie Infettive, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH