Development and validation of prediction models for mechanical ventilation, renal replacement therapy, and readmission in COVID-19 patients.
Adolescent
Adult
Aged
Aged, 80 and over
Area Under Curve
COVID-19
/ complications
Electronic Health Records
Female
Humans
Logistic Models
Male
Middle Aged
Models, Statistical
Patient Readmission
Prognosis
ROC Curve
Renal Replacement Therapy
Respiration, Artificial
Retrospective Studies
Statistics, Nonparametric
Young Adult
COVID-19
artificial
patient readmission
renal replacement therapy
respiration
supervised machine learning
Journal
Journal of the American Medical Informatics Association : JAMIA
ISSN: 1527-974X
Titre abrégé: J Am Med Inform Assoc
Pays: England
ID NLM: 9430800
Informations de publication
Date de publication:
14 07 2021
14 07 2021
Historique:
received:
20
09
2020
revised:
09
01
2021
accepted:
05
02
2021
pubmed:
12
3
2021
medline:
28
7
2021
entrez:
11
3
2021
Statut:
ppublish
Résumé
Coronavirus disease 2019 (COVID-19) patients are at risk for resource-intensive outcomes including mechanical ventilation (MV), renal replacement therapy (RRT), and readmission. Accurate outcome prognostication could facilitate hospital resource allocation. We develop and validate predictive models for each outcome using retrospective electronic health record data for COVID-19 patients treated between March 2 and May 6, 2020. For each outcome, we trained 3 classes of prediction models using clinical data for a cohort of SARS-CoV-2 (severe acute respiratory syndrome coronavirus 2)-positive patients (n = 2256). Cross-validation was used to select the best-performing models per the areas under the receiver-operating characteristic and precision-recall curves. Models were validated using a held-out cohort (n = 855). We measured each model's calibration and evaluated feature importances to interpret model output. The predictive performance for our selected models on the held-out cohort was as follows: area under the receiver-operating characteristic curve-MV 0.743 (95% CI, 0.682-0.812), RRT 0.847 (95% CI, 0.772-0.936), readmission 0.871 (95% CI, 0.830-0.917); area under the precision-recall curve-MV 0.137 (95% CI, 0.047-0.175), RRT 0.325 (95% CI, 0.117-0.497), readmission 0.504 (95% CI, 0.388-0.604). Predictions were well calibrated, and the most important features within each model were consistent with clinical intuition. Our models produce performant, well-calibrated, and interpretable predictions for COVID-19 patients at risk for the target outcomes. They demonstrate the potential to accurately estimate outcome prognosis in resource-constrained care sites managing COVID-19 patients. We develop and validate prognostic models targeting MV, RRT, and readmission for hospitalized COVID-19 patients which produce accurate, interpretable predictions. Additional external validation studies are needed to further verify the generalizability of our results.
Identifiants
pubmed: 33706377
pii: 6168488
doi: 10.1093/jamia/ocab029
pmc: PMC7989331
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
1480-1488Subventions
Organisme : NLM NIH HHS
ID : F31 LM012894
Pays : United States
Organisme : NIH HHS
ID : F31LM012894
Pays : United States
Organisme : NHLBI NIH HHS
Pays : United States
Organisme : NLM NIH HHS
ID : T15 LM007079
Pays : United States
Organisme : NLM NIH HHS
ID : R01HL148248
Pays : United States
Organisme : NLM NIH HHS
ID : 5T15LM007079
Pays : United States
Informations de copyright
© The Author(s) 2021. Published by Oxford University Press on behalf of the American Medical Informatics Association.
Références
QJM. 2020 Sep 1;113(9):657-665
pubmed: 32442308
N Engl J Med. 2016 Sep 29;375(13):1216-9
pubmed: 27682033
J Am Soc Nephrol. 2021 Jan;32(1):151-160
pubmed: 32883700
N Engl J Med. 2020 Apr 30;382(18):e41
pubmed: 32212516
Kidney Int Rep. 2020 Jun 25;5(8):1149-1160
pubmed: 32775814
J Am Med Inform Assoc. 2012 Jan-Feb;19(1):54-60
pubmed: 22037893
Am J Respir Crit Care Med. 2020 Oct 1;202(7):996-1004
pubmed: 32551817
BMJ. 2020 May 22;369:m1966
pubmed: 32444366
Acad Emerg Med. 2020 May;27(5):375-378
pubmed: 32320506
Nephrol Dial Transplant. 2011 Oct;26(10):3202-6
pubmed: 21765052
Lancet. 2020 Jun 6;395(10239):1763-1770
pubmed: 32442528
Int J Gen Med. 2020 Dec 02;13:1359-1366
pubmed: 33299342
J Bone Miner Res. 2012 Jun;27(6):1397-404
pubmed: 22367889
BMJ. 2020 May 29;369:m1996
pubmed: 32471884
JAMA. 2020 May 26;323(20):2052-2059
pubmed: 32320003
Stat Med. 2016 Mar 30;35(7):1159-77
pubmed: 26514699
J Clin Epidemiol. 2019 Jun;110:12-22
pubmed: 30763612
Clin J Am Soc Nephrol. 2020 Jun 8;15(6):880-882
pubmed: 32345750
N Engl J Med. 2020 Jun 11;382(24):2372-2374
pubmed: 32302078
Nat Med. 2020 Jan;26(1):29-38
pubmed: 31932803
J Clin Epidemiol. 2020 Sep;125:183-187
pubmed: 32540389
Blood Purif. 2017;43(1-3):57-67
pubmed: 27915348
PLoS One. 2015 Jul 14;10(7):e0132485
pubmed: 26172121
Electron J Stat. 2015;9(1):1583-1607
pubmed: 26279737
J Gen Intern Med. 2020 Oct;35(10):2838-2844
pubmed: 32815060