Prevalence and Predictability of Low-Yield Inpatient Laboratory Diagnostic Tests.


Journal

JAMA network open
ISSN: 2574-3805
Titre abrégé: JAMA Netw Open
Pays: United States
ID NLM: 101729235

Informations de publication

Date de publication:
04 09 2019
Historique:
entrez: 12 9 2019
pubmed: 12 9 2019
medline: 19 6 2020
Statut: epublish

Résumé

Laboratory testing is an important target for high-value care initiatives, constituting the highest volume of medical procedures. Prior studies have found that up to half of all inpatient laboratory tests may be medically unnecessary, but a systematic method to identify these unnecessary tests in individual cases is lacking. To systematically identify low-yield inpatient laboratory testing through personalized predictions. In this retrospective diagnostic study with multivariable prediction models, 116 637 inpatients treated at Stanford University Hospital from January 1, 2008, to December 31, 2017, a total of 60 929 inpatients treated at University of Michigan from January 1, 2015, to December 31, 2018, and 13 940 inpatients treated at the University of California, San Francisco from January 1 to December 31, 2018, were assessed. Diagnostic accuracy measures, including sensitivity, specificity, negative predictive values (NPVs), positive predictive values (PPVs), and area under the receiver operating characteristic curve (AUROC), of machine learning models when predicting whether inpatient laboratory tests yield a normal result as defined by local laboratory reference ranges. In the recent data sets (July 1, 2014, to June 30, 2017) from Stanford University Hospital (including 22 664 female inpatients with a mean [SD] age of 58.8 [19.0] years and 22 016 male inpatients with a mean [SD] age of 59.0 [18.1] years), among the top 20 highest-volume tests, 792 397 were repeats of orders within 24 hours, including tests that are physiologically unlikely to yield new information that quickly (eg, white blood cell differential, glycated hemoglobin, and serum albumin level). The best-performing machine learning models predicted normal results with an AUROC of 0.90 or greater for 12 stand-alone laboratory tests (eg, sodium AUROC, 0.92 [95% CI, 0.91-0.93]; sensitivity, 98%; specificity, 35%; PPV, 66%; NPV, 93%; lactate dehydrogenase AUROC, 0.93 [95% CI, 0.93-0.94]; sensitivity, 96%; specificity, 65%; PPV, 71%; NPV, 95%; and troponin I AUROC, 0.92 [95% CI, 0.91-0.93]; sensitivity, 88%; specificity, 79%; PPV, 67%; NPV, 93%) and 10 common laboratory test components (eg, hemoglobin AUROC, 0.94 [95% CI, 0.92-0.95]; sensitivity, 99%; specificity, 17%; PPV, 90%; NPV, 81%; creatinine AUROC, 0.96 [95% CI, 0.96-0.97]; sensitivity, 93%; specificity, 83%; PPV, 79%; NPV, 94%; and urea nitrogen AUROC, 0.95 [95% CI, 0.94, 0.96]; sensitivity, 87%; specificity, 89%; PPV, 77%; NPV 94%). The findings suggest that low-yield diagnostic testing is common and can be systematically identified through data-driven methods and patient context-aware predictions. Implementing machine learning models appear to be able to quantify the level of uncertainty and expected information gained from diagnostic tests explicitly, with the potential to encourage useful testing and discourage low-value testing that incurs direct costs and indirect harms.

Identifiants

pubmed: 31509205
pii: 2749559
doi: 10.1001/jamanetworkopen.2019.10967
pmc: PMC6739729
doi:

Substances chimiques

Glycated Hemoglobin A 0
Hemoglobins 0
Troponin I 0
hemoglobin A1c protein, human 0
L-Lactate Dehydrogenase EC 1.1.1.27

Types de publication

Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

e1910967

Subventions

Organisme : NCATS NIH HHS
ID : UL1 TR003142
Pays : United States
Organisme : NIEHS NIH HHS
ID : K01 ES026837
Pays : United States
Organisme : NCRR NIH HHS
ID : UL1 RR025744
Pays : United States

Commentaires et corrections

Type : ErratumIn

Références

J Am Med Inform Assoc. 2005 Sep-Oct;12(5):546-53
pubmed: 15905483
J Gen Intern Med. 2005 Jun;20(6):520-4
pubmed: 15987327
Postgrad Med J. 2006 Dec;82(974):823-9
pubmed: 17148707
JAMA. 1991 May 1;265(17):2229-31
pubmed: 1901611
J Hosp Med. 2009 Feb;4(2):112-23
pubmed: 19219920
Arch Intern Med. 2011 Oct 10;171(18):1646-53
pubmed: 21824940
J Am Med Inform Assoc. 2012 Jul-Aug;19(4):529-32
pubmed: 22249966
Pediatr Crit Care Med. 2013 May;14(4):413-9
pubmed: 23439456
JAMA Intern Med. 2013 May 27;173(10):903-8
pubmed: 23588900
J Hosp Med. 2013 Sep;8(9):506-12
pubmed: 23873739
Clin Chim Acta. 2014 Jan 1;427:145-50
pubmed: 24084504
J Neurosurg. 2014 Jan;120(1):173-7
pubmed: 24125592
PLoS One. 2013 Nov 15;8(11):e78962
pubmed: 24260139
JAMA Intern Med. 2014 Jun;174(6):991-3
pubmed: 24756486
J Hosp Med. 2015 Jan;10(1):1-7
pubmed: 25044190
J Patient Saf. 2017 Dec;13(4):211-216
pubmed: 25290084
J Gen Intern Med. 2015 Feb;30(2):221-8
pubmed: 25373832
Ann Intern Med. 2015 Jan 6;162(1):55-63
pubmed: 25560714
J Hosp Med. 2015 Jun;10(6):390-5
pubmed: 25809958
BMC Med Inform Decis Mak. 2015 Feb 22;15:11
pubmed: 25880934
J Hosp Med. 2016 Jan;11(1):65-76
pubmed: 26498736
JAMA. 2015 Dec 8;314(22):2384-400
pubmed: 26647260
Am J Clin Pathol. 2016 Mar;145(3):355-64
pubmed: 27124918
Am J Clin Pathol. 2016 Jun;145(6):778-88
pubmed: 27329638
J Hosp Med. 2016 Dec;11(12):869-872
pubmed: 27520384
N Engl J Med. 2016 Sep 29;375(13):1216-9
pubmed: 27682033
J Am Med Inform Assoc. 2017 Jul 1;24(4):776-780
pubmed: 28339692
Am J Med. 2017 Sep;130(9):1112.e1-1112.e7
pubmed: 28344140
BMC Med Inform Decis Mak. 2017 Apr 10;17(1):36
pubmed: 28395667
JAMA Intern Med. 2017 Jul 1;177(7):939-945
pubmed: 28430829
J Hosp Med. 2017 May;12(5):336-338
pubmed: 28459903
N Engl J Med. 2017 Jun 29;376(26):2507-2509
pubmed: 28657867
Postgrad Med J. 2017 Dec;93(1106):725-729
pubmed: 28663352
JAMA Intern Med. 2017 Oct 1;177(10):1508-1512
pubmed: 28806444
JAMA Intern Med. 2017 Dec 1;177(12):1833-1839
pubmed: 29049500
Clin Chem Lab Med. 2018 Mar 28;56(4):516-524
pubmed: 29055936
JAMA. 2017 Nov 7;318(17):1668-1678
pubmed: 29114831
Syst Rev. 2017 Dec 13;6(1):255
pubmed: 29237488
JAMA. 2018 Apr 3;319(13):1317-1318
pubmed: 29532063
Diagnosis (Berl). 2015 Feb 1;2(1):41-51
pubmed: 29540013
J Gen Intern Med. 2019 Jan;34(1):29-30
pubmed: 30215176
AMIA Jt Summits Transl Sci Proc. 2019 May 06;2019:515-523
pubmed: 31259006
Ann Intern Med. 1987 Feb;106(2):275-91
pubmed: 3541727
N Engl J Med. 1980 May 15;302(20):1109-17
pubmed: 7366635

Auteurs

Song Xu (S)

Center for Biomedical Informatics Research, Department of Medicine, Stanford University, Stanford, California.

Jason Hom (J)

Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California.

Santhosh Balasubramanian (S)

Center for Biomedical Informatics Research, Department of Medicine, Stanford University, Stanford, California.

Lee F Schroeder (LF)

Department of Pathology, University of Michigan School of Medicine, Ann Arbor.

Nader Najafi (N)

Department of Medicine, University of California, San Francisco.

Shivaal Roy (S)

Department of Computer Science, Stanford University, Stanford, California.

Jonathan H Chen (JH)

Center for Biomedical Informatics Research, Department of Medicine, Stanford University, Stanford, California.
Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH