Influence diagnostics and outlier detection for meta-analysis of diagnostic test accuracy.
Algorithms
Area Under Curve
Bayes Theorem
Child
Diagnostic Tests, Routine
False Positive Reactions
Humans
Meta-Analysis as Topic
Probability
Publication Bias
ROC Curve
Reference Standards
Regression Analysis
Reproducibility of Results
Research Design
Sensitivity and Specificity
Urinary Tract Infections
/ diagnostic imaging
Vesico-Ureteral Reflux
/ diagnostic imaging
bivariate meta-analysis
influence diagnostics
meta-analysis for diagnostic accuracy studies
outlier detection
summary receiver operating characteristic curve
Journal
Research synthesis methods
ISSN: 1759-2887
Titre abrégé: Res Synth Methods
Pays: England
ID NLM: 101543738
Informations de publication
Date de publication:
Mar 2020
Mar 2020
Historique:
received:
25
06
2019
revised:
12
11
2019
accepted:
13
11
2019
pubmed:
15
11
2019
medline:
29
12
2020
entrez:
15
11
2019
Statut:
ppublish
Résumé
Meta-analyses of diagnostic test accuracy (DTA) studies have been gaining prominence in research in clinical epidemiology and health technology development. In these DTA meta-analyses, some studies may have markedly different characteristics from the others and potentially be inappropriate to include. The inclusion of these "outlying" studies might lead to biases, yielding misleading results. In addition, there might be influential studies that have notable impacts on the results. In this article, we propose Bayesian methods for detecting outlying studies and their influence diagnostics in DTA meta-analyses. Synthetic influence measures based on the bivariate hierarchical Bayesian random effects models are developed because the overall influences of individual studies should be simultaneously assessed by the two outcome variables and their correlation information. We propose four synthetic measures for influence analyses: (a) relative distance, (b) standardized residual, (c) Bayesian p-value, and (d) influence statistic on the area under the summary receiver operating characteristic curve. We also show that conventional univariate Bayesian influential measures can be applied to the bivariate random effects models, which can be used as marginal influential measures. Most of these methods can be similarly applied to the frequentist framework. We illustrate the effectiveness of the proposed methods by applying them to a DTA meta-analysis of ultrasound in screening for vesicoureteral reflux among children with urinary tract infections.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
237-247Subventions
Organisme : Japan Society for the Promotion of Science, Grants-in-Aid for Scientific Research
ID : JP17K19808
Organisme : Japan Society for the Promotion of Science, Grants-in-Aid for Scientific Research
ID : JP19H04074
Informations de copyright
© 2019 John Wiley & Sons, Ltd.
Références
Deeks JJ. Systematic reviews in health care: systematic reviews of evaluations of diagnostic and screening tests. BMJ. 2001;323(7305):157-162.
Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM. Cochrane Diagnostic Test Accuracy Working G. Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008;149(12):889-897.
Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007;8(2):239-251.
Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58(10):982-990.
Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20(19):2865-2884.
van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002;21(4):589-624.
van Houwelingen HC, Zwinderman KH, Stijnen T. A bivariate approach to meta-analysis. Stat Med. 1993;12(24):2273-2284.
Arends LR, Hamza TH, van Houwelingen JC, Heijenbrok-Kal MH, Hunink MG, Stijnen T. Bivariate random effects meta-analysis of ROC curves. Med Decis Making. 2008;28(5):621-638.
Verde PE. Meta-analysis of diagnostic test data: a bivariate Bayesian modeling approach. Stat Med. 2010;29(30):3088-3102.
Verde PE. bamdit: an R package for Bayesian meta-analysis of diagnostic test data. J Stat Softw. 2018;86(10):1-32.
MIDAS: Stata module for meta-analytical integration of diagnostic test accuracy studies [computer program]. Statistical Software Components S456880, Boston College Department of Economics; 2007.
Harbord RM, Whiting P. metandi: meta-analysis of diagnostic accuracy using hierarchical logistic regression. Stata J. 2009;9(2):211-229.
Negeri ZF, Beyene J. Statistical methods for detecting outlying and influential studies in meta-analysis of diagnostic test accuracy studies. Stat Methods Med Res. 2019;DOI:0962280219852747. https://doi.org/10.1177/0962280219852747
Carlin BP, Louis TA. Bayesian Methods for Data Analysis. 3rd ed. Boca Raton, FL: Chapman and Hall/CRC Press; 2009.
Zhang J, Fu H, Carlin BP. Detecting outlying trials in network meta-analysis. Stat Med. 2015;34(19):2695-2707.
Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59(12):1331-1333.
Shaikh N, Spingarn RB, Hum SW. Dimercaptosuccinic acid scan or ultrasound in screening for vesicoureteral reflux among children with urinary tract infections. Cochrane Database Syst Rev. 2016;7:CD010657.
Lunn D, Jackson C, Best N, Thomas A, Spiegelhalter D. The BUGS Book: A Practical Introduction to Bayesian Analysis. Boca Raton: Chapman and Hall/CRC; 2012.
Lunn D, Spiegelhalter D, Thomas A, Best N. The BUGS project: evolution, critique and future directions. Stat Med. 2009;28(25):3049-3067.
Belsley DA, Kuh E, Welsch RE. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. Hoboken, New Jersey: John Wiley & Sons; 1980.
Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129-1135.
Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian Data Analysis. 3rd ed. Boca Raton, FL: Chapman and Hall/CRC Press; 2013.
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2018.
Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y. Chapter 10: Analysing and presenting results. In: Deeks JJ, Bossuyt PM, Gatsonis C, eds. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0. London, UK: The Cochrane Collaboration; 2010.
Viechtbauer W, Cheung MW. Outlier and influence diagnostics for meta-analysis. Res Synth Methods. 2010;1(2):112-125.