A primer on quantitative bias analysis with positive predictive values in research using electronic health data.


Journal

Journal of the American Medical Informatics Association : JAMIA
ISSN: 1527-974X
Titre abrégé: J Am Med Inform Assoc
Pays: England
ID NLM: 9430800

Informations de publication

Date de publication:
01 12 2019
Historique:
received: 23 01 2019
revised: 12 04 2019
accepted: 17 05 2019
pubmed: 1 8 2019
medline: 17 2 2021
entrez: 1 8 2019
Statut: ppublish

Résumé

In health informatics, there have been concerns with reuse of electronic health data for research, including potential bias from incorrect or incomplete outcome ascertainment. In this tutorial, we provide a concise review of predictive value-based quantitative bias analysis (QBA), which comprises epidemiologic methods that use estimates of data quality accuracy to quantify the bias caused by outcome misclassification. Health informaticians and investigators reusing large, electronic health data sources for research. When electronic health data are reused for research, validation of outcome case definitions is recommended, and positive predictive values (PPVs) are the most commonly reported measure. Typically, case definitions with high PPVs are considered to be appropriate for use in research. However, in some studies, even small amounts of misclassification can cause bias. In this tutorial, we introduce methods for quantifying this bias that use predictive values as inputs. Using epidemiologic principles and examples, we first describe how multiple factors influence misclassification bias, including outcome misclassification levels, outcome prevalence, and whether outcome misclassification levels are the same or different by exposure. We then review 2 predictive value-based QBA methods and why outcome PPVs should be stratified by exposure for bias assessment. Using simulations, we apply and evaluate the methods in hypothetical electronic health record-based immunization schedule safety studies. By providing an overview of predictive value-based QBA, we hope to bridge the disciplines of health informatics and epidemiology to inform how the impact of data quality issues can be quantified in research using electronic health data sources.

Identifiants

pubmed: 31365086
pii: 5542032
doi: 10.1093/jamia/ocz094
pmc: PMC6857512
doi:

Types de publication

Journal Article Research Support, N.I.H., Extramural Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

1664-1674

Subventions

Organisme : NIAID NIH HHS
ID : R01 AI107721
Pays : United States

Informations de copyright

© The Author(s) 2019. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Références

Pharmacoepidemiol Drug Saf. 2012 Jan;21 Suppl 1:90-9
pubmed: 22262597
JAMA Pediatr. 2013 Mar 1;167(3):274-81
pubmed: 23338829
J Clin Epidemiol. 2012 Mar;65(3):343-349.e2
pubmed: 22197520
J Am Med Inform Assoc. 2013 Jan 1;20(1):117-21
pubmed: 22955496
PLoS One. 2013 Oct 09;8(10):e75256
pubmed: 24130696
MMWR Morb Mortal Wkly Rep. 2018 Feb 09;67(5):156-157
pubmed: 29420458
Int J Epidemiol. 2005 Jun;34(3):680-7
pubmed: 15802377
Curr Epidemiol Rep. 2014 Dec;1(4):175-185
pubmed: 26085977
Am J Epidemiol. 1993 Dec 1;138(11):1007-15
pubmed: 8256775
J Clin Epidemiol. 2011 Aug;64(8):821-9
pubmed: 21194889
J Am Med Inform Assoc. 2018 Nov 1;25(11):1567-1578
pubmed: 30137498
Int J Epidemiol. 1996 Dec;25(6):1107-16
pubmed: 9027513
Int J Epidemiol. 2014 Dec;43(6):1969-85
pubmed: 25080530
J Clin Epidemiol. 2011 Oct;64(10):1054-9
pubmed: 21474278
Am J Epidemiol. 1977 May;105(5):488-95
pubmed: 871121
Pharmacoepidemiol Drug Saf. 2015 Oct;24(10):1009-16
pubmed: 26282185
Clin Epidemiol. 2017 Dec 01;9:643-656
pubmed: 29238227
J Am Med Inform Assoc. 2013 Jan 1;20(1):144-51
pubmed: 22733976
Am J Epidemiol. 2014 Jan 1;179(1):27-38
pubmed: 24100956
Epidemiology. 2014 Nov;25(6):910-2
pubmed: 25265136
Epidemiology. 2014 Nov;25(6):902-9
pubmed: 25120106
Epidemiology. 2015 May;26(3):390-4
pubmed: 25756221
Matern Child Health J. 2010 Nov;14(6):922-30
pubmed: 19760163
Int J Epidemiol. 2006 Aug;35(4):1074-81
pubmed: 16709616
J Clin Epidemiol. 2004 Feb;57(2):131-41
pubmed: 15125622
Vaccine. 2014 Sep 22;32(42):5390-8
pubmed: 25108215
EGEMS (Wash DC). 2015 Mar 23;3(1):1052
pubmed: 25992385
Ann Allergy Asthma Immunol. 2015 May;114(5):393-8
pubmed: 25771155
Vaccine. 2016 Feb 15;34 Suppl 1:A1-A29
pubmed: 26830300
J Clin Epidemiol. 2005 Apr;58(4):323-37
pubmed: 15862718
J Am Med Inform Assoc. 1997 Sep-Oct;4(5):342-55
pubmed: 9292840
Can J Cardiol. 2017 Aug;33(8):1052-1059
pubmed: 28754391
Pharmacoepidemiol Drug Saf. 2016 Dec;25(12):1343-1353
pubmed: 27593968
EGEMS (Wash DC). 2016 Jul 05;4(3):1232
pubmed: 27563686
Pharmacoepidemiol Drug Saf. 2018 Feb;27(2):221-228
pubmed: 29292551
Ann Epidemiol. 2004 Aug;14(7):507-16
pubmed: 15301787
Pediatr Pulmonol. 2006 Oct;41(10):962-71
pubmed: 16871628
Annu Rev Public Health. 2016;37:61-81
pubmed: 26667605
Epidemiology. 2014 Jul;25(4):576-82
pubmed: 24815306

Auteurs

Sophia R Newcomer (SR)

School of Public and Community Health Sciences, University of Montana, Missoula, Montana, USA.
Institute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.

Stan Xu (S)

Institute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.

Martin Kulldorff (M)

Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.

Matthew F Daley (MF)

Institute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.
Department of Pediatrics, School of Medicine, University of Colorado Denver, Aurora, Colorado, USA.

Bruce Fireman (B)

Division of Research, Vaccine Study Center, Kaiser Permanente Northern California, Oakland, California, USA.

Jason M Glanz (JM)

Institute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.
Department of Epidemiology, School of Public Health, University of Colorado Denver, Aurora, Colorado, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH