How subgroup analyses can miss the trees for the forest plots: A simulation study.
Biometry
/ methods
Clinical Trials as Topic
Computer Simulation
/ statistics & numerical data
Data Interpretation, Statistical
Female
Humans
Male
Models, Statistical
Models, Theoretical
Myocardial Infarction
/ epidemiology
Reproducibility of Results
Research Design
/ statistics & numerical data
Sample Size
Selection Bias
Subgroups
causal graphs
external validity
selection bias
Journal
Journal of clinical epidemiology
ISSN: 1878-5921
Titre abrégé: J Clin Epidemiol
Pays: United States
ID NLM: 8801383
Informations de publication
Date de publication:
10 2020
10 2020
Historique:
received:
28
01
2020
revised:
09
06
2020
accepted:
16
06
2020
pubmed:
23
6
2020
medline:
5
3
2021
entrez:
23
6
2020
Statut:
ppublish
Résumé
Subgroup analyses of clinical trial data can be an important tool for understanding when treatment effects differ across populations. That said, even effect estimates from prespecified subgroups in well-conducted trials may not apply to corresponding subgroups in the source population. While this divergence may simply reflect statistical imprecision, there has been less discussion of systematic or structural sources of misleading subgroup estimates. We use directed acyclic graphs to show how selection bias caused by associations between effect measure modifiers and trial selection, whether explicit (e.g., eligibility criteria) or implicit (e.g., self-selection based on race), can result in subgroup estimates that do not correspond to subgroup effects in the source population. To demonstrate this point, we provide a hypothetical example illustrating the sorts of erroneous conclusions that can result, as well as their potential consequences. We also provide a tool for readers to explore additional cases. Treating subgroups within a trial essentially as random samples of the corresponding subgroups in the wider population can be misleading, even when analyses are conducted rigorously and all findings are internally valid. Researchers should carefully examine associations between (and consider adjusting for) variables when attempting to identify heterogeneous treatment effects.
Identifiants
pubmed: 32565216
pii: S0895-4356(20)30073-1
doi: 10.1016/j.jclinepi.2020.06.020
pmc: PMC7529905
mid: NIHMS1605361
pii:
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
65-70Subventions
Organisme : NHLBI NIH HHS
ID : R01 HL118255
Pays : United States
Informations de copyright
Copyright © 2020 Elsevier Inc. All rights reserved.
Références
Stat Methods Med Res. 2016 Oct;25(5):2193-2213
pubmed: 24448444
Eur J Epidemiol. 2015 Oct;30(10):1101-10
pubmed: 25687168
Am J Epidemiol. 2019 Feb 1;188(2):438-443
pubmed: 30299451
Am J Epidemiol. 2017 Jun 1;185(11):1048-1050
pubmed: 28535177
Epidemiology. 1999 Jan;10(1):37-48
pubmed: 9888278
Epidemiology. 2004 Sep;15(5):615-25
pubmed: 15308962
Epidemiology. 2007 Sep;18(5):569-72
pubmed: 17700243
Eur J Epidemiol. 2019 Aug;34(8):719-722
pubmed: 31218483
Cancer. 2014 Apr 1;120 Suppl 7:1091-6
pubmed: 24643646
J Clin Epidemiol. 2018 Aug;100:22-31
pubmed: 29654822
Epidemiology. 2007 Sep;18(5):561-8
pubmed: 17700242
N Engl J Med. 2011 Sep 8;365(10):883-91
pubmed: 21830957
JAMA Oncol. 2019 Aug 15;:e191870
pubmed: 31415071
Epidemiology. 2015 Jul;26(4):466-72
pubmed: 25867114
Ann Fam Med. 2007 Sep-Oct;5(5):444-52
pubmed: 17893387
Addiction. 2015 Jan;110(1):183-4
pubmed: 25515832
Am J Epidemiol. 2010 Jul 1;172(1):107-15
pubmed: 20547574
Int J Epidemiol. 2013 Jun;42(3):860-9
pubmed: 23918854
Health Technol Assess. 2001;5(33):1-56
pubmed: 11701102
Am J Epidemiol. 2017 Oct 15;186(8):1010-1014
pubmed: 28535275
N Engl J Med. 2011 Sep 15;365(11):981-92
pubmed: 21870978
Int J Epidemiol. 2010 Apr;39(2):417-20
pubmed: 19926667
Ann Intern Med. 2011 May 17;154(10):680-3
pubmed: 21576536
JAMA. 2004 Jun 9;291(22):2720-6
pubmed: 15187053
N Engl J Med. 2009 Sep 17;361(12):1139-51
pubmed: 19717844
JAMA. 1998 May 27;279(20):1615-22
pubmed: 9613910