What Are They Worth? Six 30-Day Readmission Risk Scores for Medical Inpatients Externally Validated in a Swiss Cohort.
Journal
Journal of general internal medicine
ISSN: 1525-1497
Titre abrégé: J Gen Intern Med
Pays: United States
ID NLM: 8605834
Informations de publication
Date de publication:
07 2020
07 2020
Historique:
received:
11
09
2019
accepted:
03
01
2020
revised:
24
11
2019
pubmed:
23
1
2020
medline:
15
5
2021
entrez:
23
1
2020
Statut:
ppublish
Résumé
Several clinical risk scores for unplanned 30-day readmission have been published, but there is a lack of external validation and head-to-head comparison. Retrospective replication of six clinical risk scores (LACE, HOSPITAL, SEMI, RRS, PARA, Tsui et al.)f DESIGN: Models were fitted with the original intercept and beta coefficients as reported. Otherwise, a logistic model was refitted (SEMI and Tsui et al). We performed subgroup analyses on main admission specialty. This report adheres to the TRIPOD statement for reporting of prediction models. We used our prospective cohort of 15,639 medical patients from a Swiss tertiary care institution from 2016 through 2018. Thirty-day readmission rate and area under the curve (AUC < 0.50 worse than chance, > 0.70 acceptable, > 0.80 excellent) CONCLUSIONS: Among several readmission risk scores, HOSPITAL, PARA, and the score from Tsui et al. showed the best predictive abilities and have high potential to improve patient care. Interventional research is now needed to understand the effects of these scores when used in clinical routine. Among the six risk scores externally validated, calibration of the models was overall poor with overprediction of events, except for the HOSPITAL and the PARA scores. Discriminative abilities (AUC) were as follows: LACE 0.53 (95% CI 0.50-0.56), HOSPITAL 0.73 (95% CI 0.72-0.74), SEMI 0.47 (95% CI 0.46-0.49), RRS 0.64 (95% CI 0.62-0.66), PARA 0.72 (95% CI 0.72-0.74), and the score from Tsui et al. 0.73 (95% CI 0.72-0.75). Performance in subgroups did not differ from the overall performance, except for oncology patients in the PARA score (0.57, 95% CI 0.54-0.60), and nephrology patients in the SEMI index (0.25, 95% CI 0.18-0.31), respectively.
Sections du résumé
BACKGROUND
Several clinical risk scores for unplanned 30-day readmission have been published, but there is a lack of external validation and head-to-head comparison.
OBJECTIVE
Retrospective replication of six clinical risk scores (LACE, HOSPITAL, SEMI, RRS, PARA, Tsui et al.)f DESIGN: Models were fitted with the original intercept and beta coefficients as reported. Otherwise, a logistic model was refitted (SEMI and Tsui et al). We performed subgroup analyses on main admission specialty. This report adheres to the TRIPOD statement for reporting of prediction models.
PARTICIPANTS
We used our prospective cohort of 15,639 medical patients from a Swiss tertiary care institution from 2016 through 2018.
MAIN MEASURES
Thirty-day readmission rate and area under the curve (AUC < 0.50 worse than chance, > 0.70 acceptable, > 0.80 excellent) CONCLUSIONS: Among several readmission risk scores, HOSPITAL, PARA, and the score from Tsui et al. showed the best predictive abilities and have high potential to improve patient care. Interventional research is now needed to understand the effects of these scores when used in clinical routine.
KEY RESULTS
Among the six risk scores externally validated, calibration of the models was overall poor with overprediction of events, except for the HOSPITAL and the PARA scores. Discriminative abilities (AUC) were as follows: LACE 0.53 (95% CI 0.50-0.56), HOSPITAL 0.73 (95% CI 0.72-0.74), SEMI 0.47 (95% CI 0.46-0.49), RRS 0.64 (95% CI 0.62-0.66), PARA 0.72 (95% CI 0.72-0.74), and the score from Tsui et al. 0.73 (95% CI 0.72-0.75). Performance in subgroups did not differ from the overall performance, except for oncology patients in the PARA score (0.57, 95% CI 0.54-0.60), and nephrology patients in the SEMI index (0.25, 95% CI 0.18-0.31), respectively.
Identifiants
pubmed: 31965531
doi: 10.1007/s11606-020-05638-z
pii: 10.1007/s11606-020-05638-z
pmc: PMC7351934
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
2017-2024Subventions
Organisme : Swiss National Science Foundation
ID : PP00P3_150531 / 1
Pays : Switzerland
Références
Lancet. 2012 Jul 7;380(9836):37-43
pubmed: 22579043
Med Care. 2006 Nov;44(11):972-81
pubmed: 17063128
Evid Based Nurs. 2016 Apr;19(2):62
pubmed: 26701748
JAMA. 2017 Dec 26;318(24):2466-2482
pubmed: 29279934
Swiss Med Wkly. 2016 Aug 06;146:w14335
pubmed: 27497141
Swiss Med Wkly. 2017 Sep 25;147:w14493
pubmed: 28944935
JAMA Intern Med. 2014 Jul;174(7):1095-107
pubmed: 24820131
Swiss Med Wkly. 2017 Jul 27;147:w14470
pubmed: 28750417
BMJ Open. 2016 Jun 27;6(6):e011060
pubmed: 27354072
Geriatr Nurs. 2015 Nov-Dec;36(6):451-7
pubmed: 26234641
Med Care. 2015 Nov;53(11):916-23
pubmed: 26465120
BMJ Qual Saf. 2017 Oct;26(10):799-805
pubmed: 28416652
N Engl J Med. 2019 Apr 4;380(14):1347-1358
pubmed: 30943338
BMC Health Serv Res. 2019 Apr 23;19(1):237
pubmed: 31014343
JAMA Netw Open. 2019 Mar 1;2(3):e190348
pubmed: 30848808
BMC Health Serv Res. 2008 Jul 22;8:154
pubmed: 18647410
BMC Health Serv Res. 2010 Jul 21;10:216
pubmed: 20663141
N Engl J Med. 2018 Jul 5;379(1):64-73
pubmed: 29972754
Health Care Manag Sci. 2013 Jun;16(2):167-75
pubmed: 23355120
BMJ Open. 2012 Aug 10;2(4):
pubmed: 22885591
Health Informatics J. 2015 Mar;21(1):46-56
pubmed: 24352596
Am J Med. 2016 Jan;129(1):89-95
pubmed: 26344631
CMAJ. 2010 Apr 6;182(6):551-7
pubmed: 20194559
Online J Public Health Inform. 2013 Jul 01;5(2):219
pubmed: 24224068
BMJ. 2012 Jun 19;344:e4152
pubmed: 22718915
J Chronic Dis. 1987;40(5):373-83
pubmed: 3558716
J Am Med Inform Assoc. 2014 Mar-Apr;21(2):272-9
pubmed: 24076748
Am Heart J. 2016 Sep;179:51-8
pubmed: 27595679
Appl Clin Inform. 2013 Apr 03;4(2):153-69
pubmed: 23874355
Artif Intell Med. 2015 Oct;65(2):89-96
pubmed: 26363683
Ann Intern Med. 2015 Jan 6;162(1):W1-73
pubmed: 25560730
Open Med. 2012 Jul 19;6(3):e80-90
pubmed: 23696773
Ont Health Technol Assess Ser. 2013 Sep 01;13(4):1-72
pubmed: 24167538
JAMA Intern Med. 2013 Apr 22;173(8):632-8
pubmed: 23529115
PLoS One. 2017 Jan 3;12(1):e0168757
pubmed: 28045940
Acad Emerg Med. 2007 Jul;14(7):662-8
pubmed: 17538078
Int J Evid Based Healthc. 2018 Sep;16(3):174-181
pubmed: 29634597
CMAJ. 2015 Aug 11;187(11):799-804
pubmed: 26009583
Eur J Intern Med. 2012 Jul;23(5):451-6
pubmed: 22726375
BMC Geriatr. 2013 Jul 06;13:70
pubmed: 23829698
BMC Emerg Med. 2013 Jul 04;13:12
pubmed: 23822525