Assessing safety at the end of clinical trials using system organ classes: A case and comparative study.
Bayesian hierarchy
adverse events
false discovery rate
safety
system organ class
Journal
Pharmaceutical statistics
ISSN: 1539-1612
Titre abrégé: Pharm Stat
Pays: England
ID NLM: 101201192
Informations de publication
Date de publication:
11 2021
11 2021
Historique:
received:
06
01
2021
accepted:
14
06
2021
pubmed:
26
6
2021
medline:
27
1
2022
entrez:
25
6
2021
Statut:
ppublish
Résumé
Recent approaches to the statistical analysis of adverse event (AE) data in clinical trials have proposed the use of groupings of related AEs, such as by system organ class (SOC). These methods have opened up the possibility of scanning large numbers of AEs while controlling for multiple comparisons, making the comparative performance of the different methods in terms of AE detection and error rates of interest to investigators. We apply two Bayesian models and two procedures for controlling the false discovery rate (FDR), which use groupings of AEs, to real clinical trial safety data. We find that while the Bayesian models are appropriate for the full data set, the error controlling methods only give similar results to the Bayesian methods when low incidence AEs are removed. A simulation study is used to compare the relative performances of the methods. We investigate the differences between the methods over full trial data sets, and over data sets with low incidence AEs and SOCs removed. We find that while the removal of low incidence AEs increases the power of the error controlling procedures, the estimated power of the Bayesian methods remains relatively constant over all data sizes. Automatic removal of low-incidence AEs however does have an effect on the error rates of all the methods, and a clinically guided approach to their removal is needed. Overall we found that the Bayesian approaches are particularly useful for scanning the large amounts of AE data gathered.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1278-1287Subventions
Organisme : Medical Research Council
ID : MR/S003967/1
Pays : United Kingdom
Informations de copyright
© 2021 The Authors. Pharmaceutical Statistics published by John Wiley & Sons Ltd.
Références
Mehrotra DV, Adewale AJ. Flagging clinical adverse experiences: reducing false discoveries without materially compromising power for detecting true signals. Stat Med. 2012;31(18):1918-1930. https://doi.org/10.1002/sim.5310
Hu JX, Zhao H, Zhou HH. False discovery rate control with groups. J Am Stat Assoc. 2010;105(491):1215-1227. https://doi.org/10.1198/jasa.2010.tm09329.
Berry SM, Berry DA. Accounting for multiplicities in assessing drug safety: a three-level hierarchical mixture model. Biometrics. 2004;60(2):418-426. https://doi.org/10.1111/j.0006-341x.2004.00186.x.
DuMouchel W. Multivariate Bayesian logistic regression for analysis of clinical study safety issues. Stat Sci. 2012;27(3):319-339. https://doi.org/10.1214/11-sts381.
Amy Xia H, Ma H, Carlin BP. Bayesian hierarchical modeling for detecting safety signals in clinical trials. J Biopharm Stat. 2011;21(5):1006-1029. https://doi.org/10.1080/10543406.2010.520181.
Crooks CJ, Prieto-Merino D, Evans SJW. Identifying adverse events of vaccines using a Bayesian method of medically guided information sharing. Drug Saf. 2012;35(1):61-78. https://doi.org/10.2165/11596630-000000000-00000.
Wang W, Whalen E, Munsaka M, et al. On quantitative methods for clinical safety monitoring in drug development. Stat Biopharm Res. 2018;10(2):85-97. https://doi.org/10.1080/19466315.2017.1409134.
Munsaka MS. A question-based approach to the analysis of safety data. In: Peace Karl E, Ding-Geng C, Sandeep M, eds. Biopharmaceutical Applied Statistics Symposium: Volume 2 Biostatistical Analysis of Clinical Trials. Singapore: Springer Singapore; 2018:193-216.
Melvin M. A Question-Based Approach to the Analysis of Safety Data: Volume 2 Biostatistical Analysis of Clinical Trials. Singapore: Springer; 2018:193-216.
Fries M, Kracht K, Li J. Safety monitoring methodology in the premarketing setting. Proceedings of JSM. 2016:2247-2269.
Carragher R. c212: Methods for Detecting Safety Signals in Clinical Trials Using Body-Systems (System Organ Classes); 2017. https://CRAN.R-project.org/package=c212
Carragher R, Robertson C. c212: An R package for the detection of safety signals in clinical trials using body-systems (system organ classes). J Open Source Softw. 2020;5(56):2706. https://doi.org/10.21105/joss.02706.
International Conference on Harmonisation E9 Expert Working Group. Statistical principles for clinical trials. ICH harmonised tripartite guideline. Stat Med. 1999;18(15):1905-1942.
Gelman A, Hill J, Yajima M. Why we (Usually) don't have to worry about multiple comparisons. J Res Educ Effect. 2012;5(2):189-211. https://doi.org/10.1080/19345747.2011.618213.
Dunson DB, Herring AH, Engel SM. Bayesian selection and clustering of polymorphisms in functionally related genes. J Am Stat Assoc. 2008;103(482):534-546. https://doi.org/10.1198/016214507000000554.
Odani M, Fukimbara S, Sato T. A Bayesian meta-analytic approach for safety signal detection in randomized clinical trials. Clin Trials. 2017;14(2):192-200. https://doi.org/10.1177/1740774516683920.
Carragher R, Mueller T, Bennie M, Robertson C. A Bayesian hierarchical approach for multiple outcomes in routinely collected healthcare data. Stat Med. 2020;39(20):2639-2654. https://doi.org/10.1002/sim.8563.
Yoav B, Yosef H. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc Ser B. 1995;57(1):289-300.
Carragher R. Detecting Safety Signals in Randomised Controlled Trials. PhD thesis. University of Strathclyde; 2017.
Chen W, Zhao N, Qin G, Chen J. A Bayesian group sequential approach to safety signal detection. J Biopharm Stat. 2013;23(1):213-230. https://doi.org/10.1080/10543406.2013.736813.
Southworth H. Predicting potential liver toxicity from phase 2 data: a case study with ximelagatran. Stat Med. 2014;33(17):2914-2923. https://doi.org/10.1002/sim.6142.
Siddiqui O. Statistical methods to analyze adverse events data of randomized clinical trials. J Biopharm Stat. 2009;19(5):889-899. https://doi.org/10.1080/10543400903105463
Tan X, Liu GF, Zeng D, et al. Controlling false discovery proportion in identification of drug-related adverse events from multiple system organ classes. Stat Med. 2019;38(22):4378-4389. https://doi.org/10.1002/sim.8304.
Tan X, Chen BE, Sun J, Patel T, Ibrahim JG. A hierarchical testing approach for detecting safety signals in clinical trials. Stat Med. 2020;39(10):1541-1557. https://doi.org/10.1002/sim.8495.
Diao G, Liu GF, Zeng D, et al. Efficient methods for signal detection from correlated adverse events in clinical trials. Biometrics. 2019;75(3):1000-1008. https://doi.org/10.1111/biom.13031.
Carragher R. Comparative study for: “Assessing safety at the end of clinical trials using system organ classes: a case and comparative study”; 2020.