Investigating the Heterogeneity of "Study Twins".
meta‐analysis
random effects
shrinkage
sparse data
Journal
Biometrical journal. Biometrische Zeitschrift
ISSN: 1521-4036
Titre abrégé: Biom J
Pays: Germany
ID NLM: 7708048
Informations de publication
Date de publication:
Sep 2024
Sep 2024
Historique:
revised:
06
05
2024
received:
15
12
2023
accepted:
03
07
2024
medline:
3
9
2024
pubmed:
3
9
2024
entrez:
3
9
2024
Statut:
ppublish
Résumé
Meta-analyses are commonly performed based on random-effects models, while in certain cases one might also argue in favor of a common-effect model. One such case may be given by the example of two "study twins" that are performed according to a common (or at least very similar) protocol. Here we investigate the particular case of meta-analysis of a pair of studies, for example, summarizing the results of two confirmatory clinical trials in phase III of a clinical development program. Thereby, we focus on the question of to what extent homogeneity or heterogeneity may be discernible and include an empirical investigation of published ("twin") pairs of studies. A pair of estimates from two studies only provide very little evidence of homogeneity or heterogeneity of effects, and ad hoc decision criteria may often be misleading.
Identifiants
pubmed: 39223907
doi: 10.1002/bimj.202300387
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
e202300387Subventions
Organisme : Deutsche Forschungsgemeinschaft
ID : FR 3070/3-1
Informations de copyright
© 2024 The Author(s). Biometrical Journal published by Wiley‐VCH GmbH.
Références
Ades, A. E., G. Lu, and J. P. T. Higgins. 2005. “The Interpretation of Random‐Effects Meta‐Analysis in Decision Models.” Medical Decision Making 25: 646–654.
Aksamit, T., A. De Soyza, T.‐J. Bandel, et al. 2018. “RESPIRE 2: A Phase III Placebo‐Controlled Randomised Trial of Ciprofloxacin Dry Powder for Inhalation in Non‐Cystic Fibrosis Bronchiectasis.” European Respiratory Journal 51: 1702053.
Bender, R., T. Friede, A. Koch, et al. 2018. “Methods for Evidence Synthesis in the Case of Very Few Studies.” Research Synthesis Methods 9: 382–392.
Chey, W. D., L. R. Webster, M. Sostek, J. Lappalainen, P. Barker, and J. Tack. 2014. “Naloxegol for Opioid‐Induced Constipation in Patients With Noncancer Pain.” The New England Journal of Medicine 370: 2387–2396.
Chotirmall, S. H., and J. D. Chalmers. 2018. “RESPIRE: Breathing New Life Into Bronchiectasis.” European Respiratory Journal 51: 1702444.
Cochran, W. G. 1937. “Problems Arising in the Analysis of a Series of Similar Experiments.” Supplement to the Journal of the Royal Statistical Society 4: 102–118.
Cochran, W. G. 1954. “The Combination of Estimates From Different Experiments.” Biometrics 10: 101–129.
De Soyza, A., T. Aksamit, T.‐J. Bandel, et al. 2018. “RESPIRE 1: A Phase III Placebo‐Controlled Randomised Trial of Ciprofloxacin Dry Powder for Inhalation in Non‐Cystic Fibrosis Bronchiectasis.” European Respiratory Journal 51: 1702052.
DeAngelis, C. D., J. M. Drazen, F. A. Frizelle, et al. 2004. “Clinical Trial Registration: A Statement From the International Committee of Medical Journal Editors.” Journal of the American Medical Association 292: 1363–1364.
Deeks, J. J., and D. Altman. 2001. “Effect Measures for Meta‐Analysis of Trials With Binary Outcomes.” In Systematic Reviews in Health Care: Meta‐analysis in Context, edited by M. Egger, G. Davey Smith, and D. Altman, chapter 16, 313–335. 2nd ed. London: BMJ Publishing.
Dias, S., A. J. Sutton, N. J. Welton, and A. E. Ades. 2013a. “Evidence Synthesis for Decision Making 1: Introduction.” Medical Decision Making 33: 597–606.
Dias, S., A. J. Sutton, N. J. Welton, and A. E. Ades. 2013b. “Evidence Synthesis for Decision Making 3: Heterogeneity—Subgroups, Meta‐Regression, Bias, and Bias‐Adjustment.” Medical Decision Making 33: 618–640.
D'Urzo, A., G. T. Ferguson, J. A. van Noord, et al. 2011. “Efficacy and Safety of Once‐Daily NVA237 in Patients With Moderate‐to‐Severe COPD: The GLOW1 Trial.” Respiratory Research 12: 156.
D'Urzo, A., E. Kerwin, T. Overend, P. D'Andrea, H. Chen, and P. Goyal. 2013. “Once Daily Glycopyrronium for the Treatment of COPD: Pooled Analysis of the GLOW1 and GLOW2 Studies.” Current Medical Research and Opinion 30: 3.
Feagan, B. G., W. J. Sandborn, C. Gasink, et al. 2016. “Ustekinumab as Induction and Maintenance Therapy for Crohn's Disease.” The New England Journal of Medicine 375: 1946–1960.
Fleiss, J. L. 1993. “The Statistical Basis of Meta‐Analysis.” Statistical Methods in Medical Research 2: 121–145.
Friede, T., C. Röver, S. Wandel, and B. Neuenschwander. 2017a. “Meta‐Analysis of Few Small Studies in Orphan Diseases.” Research Synthesis Methods 8: 79–91.
Friede, T., C. Röver, S. Wandel, and B. Neuenschwander. 2017b. “Meta‐Analysis of two Studies in the Presence of Heterogeneity With Applications in Rare Diseases.” Biometrical Journal 59: 658–671.
Gail, M. 2005. “Stratification.” In Encyclopedia of Biostatistics, edited by P. Armitage and T. Colton. 2nd ed. Hoboken, NJ: John Wiley & Sons.
Gavaghan, D. J., R. A. Moore, and H. J. McQuay. 2000. “An Evaluation of Homogeneity Tests in Meta‐Analyses in Pain Using Simulations of Individual Patient Data.” Pain 85: 415–424.
Gelman, A., J. B. Carlin, H. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin. 2014. Bayesian Data Analysis. 3rd ed. Boca Raton, FL: Chapman & Hall/CRC.
Goodman, S. N., D. Fanelli, and J. P. A. Ioannidis. 2016. “What Does Research Reproducibility Mean?” Science Translational Medicine 8: 1–6.
Günhan, B. K., C. Röver, and T. Friede. 2020. “Random‐Effects Meta‐Analysis of Few Studies Involving Rare Events.” Research Synthesis Methods 11: 74–90.
Hardy, R. J., and S. G. Thompson. 1998. “Detecting and Describing Heterogeneity in Meta‐Analysis.” Statistics in Medicine 17: 841–856.
Hartung, J., G. Knapp, and B. K. Sinha. 2008. Statistical Meta‐Analysis With Applications. Hoboken, NJ: John Wiley & Sons.
Hauser, S. L., A. Bar‐Or, G. Comi, et al. 2017. “Ocrelizumab Versus Interferon Beta‐1a in Relapsing Multiple Sclerosis.” The New England Journal of Medicine 376: 221–234.
Higgins, J. P. T. 2008. “Commentary: Heterogeneity in Meta‐Analysis Should be Expected and Appropriately Quantified.” International Journal of Epidemiology 37: 1158–1160.
Higgins, J. P. T., J. Thomas, J. Chandler, eds. et al. 2019. Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. Hoboken, NJ: John Wiley & Sons. http://handbook.cochrane.org/.
Higgins, J. P. T., and S. G. Thompson. 2002. “Quantifying Heterogeneity in a Meta‐Analysis.” Statistics in Medicine 21: 1539–1558.
Higgins, J. P. T., S. G. Thompson, and D. J. Spiegelhalter. 2009. “A Re‐Evaluation of Random‐Effects Meta‐Analysis.” Journal of the Royal Statistical Society A 172: 137–159.
Ioannidis, J. P. A. 2008. “Interpretation of Tests of Heterogeneity and Bias in Meta‐Analysis.” Journal of Evaluation in Clinical Practice 14: 951–957.
Ioannidis, J. P. A., T. A. Trikalinos, and E. Zintzaras. 2006. “Extreme Between‐Study Homogeneity in Meta‐Analyses Could Offer Useful Insights.” Journal of Clinical Epidemiology 59: 1023–1032.
Jackson, D., M. Law, G. Rücker, and G. Schwarzer. 2017. “The Hartung‐Knapp Modification for Random‐Effects Meta‐Analysis: A Useful Refinement But are There Any Residual Concerns?” Statistics in Medicine 36: 3923–3934.
Karner, C., J. Chong, and P. Poole. 2014. “Tiotropium Versus Placebo for Chronic Obstructive Pulmonary Disease.” Cochrane Database of Systematic Reviews 7: CD009285.
Kass, A. E., and R. E. Raftery. 1995. “Bayes Factors.” Journal of the American Statistical Association 90: 773–795.
Kennedy‐Shaffer, L. 2017. “When the Alpha is the Omega: p$p$‐Values, “Substantial Evidence,” and the 0.05 Standard at the FDA.” Food and Drug Law Journal 72: 595–635.
Kerwin, E., J. Hébert, N. Gallagher, et al. 2012. “Efficacy and Safety of NVA237 Versus Placebo and Tiotropium in Patients With COPD: The GLOW2 Study.” European Respiratory Journal 40: 1106–1114.
Kontopantelis, E., D. A. Springate, and D. Reeves. 2013. “A Re‐Analysis of the Cochrane Library Data: The Dangers of Unobserved Heterogeneity in Meta‐Analyses.” PLoS ONE 8: e69930.
Pereira, T. V., N. A. Patsopoulos, G. Salanti, and J. P. A. Ioannidis. 2010. “Critical Interpretation of Cochran's Q$Q$ Test Depends on Power and Prior Assumptions About Heterogeneity.” Research Synthesis Methods 1: 149–161.
Plesser, H. E. 2018. “Reproducibility vs. Replicability: A Brief History of a Confused Terminology.” Frontiers in Neuroinformatics 11: 76.
Rhodes, K. M., R. M. Turner, and J. P. T. Higgins. 2015. “Predictive Distributions Were Developed for the Extent of Heterogeneity in Meta‐Analyses of Continuous Outcome Data.” Journal of Clinical Epidemiology 68: 52–60.
Röver, C. 2020. “Bayesian Random‐Effects Meta‐Analysis Using the Bayesmeta R Package.” Journal of Statistical Software 93: 1–51.
Röver, C., R. Bender, S. Dias, et al. 2021. “On Weakly Informative Prior Distributions for the Heterogeneity Parameter in Bayesian Random‐Effects Meta‐Analysis.” Research Synthesis Methods 12: 448–474.
Röver, C., and T. Friede. 2023. “Using the Bayesmeta R Package for Bayesian Random‐Effects Meta‐Regression.” Computer Methods and Programs in Biomedicine 229: 107303.
Röver, C., G. Knapp, and T. Friede. 2015. “Hartung‐Knapp‐Sidik‐Jonkman Approach and its Modification for Random‐Effects Meta‐Analysis With Few Studies.” BMC Medical Research Methodology 15: 99.
Röver, C., S. Sturtz, J. Lilienthal, R. Bender, and T. Friede. 2023. “Summarizing Empirical Information on Between‐Study Heterogeneity for Bayesian Random‐Effects Meta‐Analysis.” Statistics in Medicine 42: 2439–2454.
Rukhin, A. L.. 2012. “Estimating Common Mean and Heterogeneity Variance in two Study Case Meta‐Analysis.” Statistics & Probability Letters 82: 1318–1325.
Schulz, A., C. Schürmann, G. Skipka, and R. Bender. 2022. “Performing Meta‐Analyses With Very Few Studies.” In Meta‐Research: Methods and Protocols, edited by E. Evangelou and A. A. Veroniki, Methods in Molecular Biology, vol. 2345, chapter 5, 91–102. New York: Humana Press.
Shrier, I., R. W. Platt, and R. J. Steele. 2007. “Mega‐Trials vs. Meta‐Analysis: Precision vs. Heterogeneity?” Contemporary Clinical Trials 28: 324–328.
Spiegelhalter, D. J., K. R. Abrams, and J. P. Myles. 2004. Bayesian Approaches to Clinical Trials and Health‐Care Evaluation. Chichester, UK: John Wiley & Sons.
The European Agency for the Evaluation of Medicinal Products (EMEA). 2001. “Points to Consider on Application With 1. Meta‐Analyses; 2. One Pivotal Study.” CPMP/EWP/2330/99.
Tukey, J. W. 1980. “We Need Both Exploratory and Confirmatory.” The American Statistician 34: 23–25.
Turner, R. M., D. Jackson, Y. Wei, S. G. Thompson, and P. T. Higgins. 2015. “Predictive Distributions for Between‐Study Heterogeneity and Simple Methods for Their Application in Bayesian Meta‐Analysis.” Statistics in Medicine 34: 984–998.
Veroniki, A. A., D. Jackson, R. Bender, et al. 2019. “Methods to Calculate Uncertainty in the Estimated Overall Effect Size From a Random‐Effects Meta‐Analysis.” Research Synthesis Methods 10: 23–43.
Veroniki, A. A., D. Jackson, W. Viechtbauer, et al. 2016. “Methods to Estimate the Between‐Study Variance and Its Uncertainty in Meta‐Analysis.” Research Synthesis Methods 7: 55–79.
Viechtbauer, W. 2007. “Confidence Intervals for the Amount of Heterogeneity in Meta‐Analysis.” Statistics in Medicine 26: 37–52.
Viechtbauer, W. 2010. “Conducting Meta‐Analyses in R With the Metafor Package.” Journal of Statistical Software 36: 1–48.
Yusuf, S., R. Collins, and R. Peto. 1984. “Why Do We Need Some Large, Simple Randomized Trials?” Statistics in Medicine 3: 409–422.