Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis.
Journal
PLoS medicine
ISSN: 1549-1676
Titre abrégé: PLoS Med
Pays: United States
ID NLM: 101231360
Informations de publication
Date de publication:
04 2022
04 2022
Historique:
received:
07
12
2021
accepted:
01
04
2022
revised:
11
05
2022
pubmed:
28
4
2022
medline:
18
5
2022
entrez:
27
4
2022
Statut:
epublish
Résumé
We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations. We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.
Sections du résumé
BACKGROUND
We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs.
METHODS AND FINDINGS
We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations.
CONCLUSIONS
We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.
Identifiants
pubmed: 35476675
doi: 10.1371/journal.pmed.1003980
pii: PMEDICINE-D-21-05025
pmc: PMC9094518
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e1003980Déclaration de conflit d'intérêts
I have read the journal’s policy and the authors of this manuscript have the following competing interests: DG contributed to the ASPIRE project as part of his PhD thesis before his current employment with Idorsia Pharmaceuticals Ltd. (his current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). BvN contributed to the ASPIRE project as part of her PhD thesis before her current employment with Roche (her current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). All authors have declared that no competing interests exist.
Références
JAMA. 2010 May 26;303(20):2058-64
pubmed: 20501928
BMJ. 2020 Apr 14;369:m982
pubmed: 32291261
BMJ Open. 2015 May 05;5(5):e006666
pubmed: 25943371
Clin Trials. 2008;5(1):40-8
pubmed: 18283079
Lancet. 2014 Jan 18;383(9913):257-66
pubmed: 24411650
Trials. 2019 Feb 14;20(1):118
pubmed: 30760329
Trials. 2020 Oct 28;21(1):896
pubmed: 33115541
BMJ. 2013 Jan 08;346:e7586
pubmed: 23303884
Trials. 2018 Aug 23;19(1):448
pubmed: 30134950
JAMA. 2004 May 26;291(20):2457-65
pubmed: 15161896
PLoS One. 2014 Dec 23;9(12):e114023
pubmed: 25536072
Swiss Med Wkly. 2008 Apr 5;138(13-14):197-203
pubmed: 18389392
J Clin Epidemiol. 2021 Nov;139:340-349
pubmed: 34029678
Health Sci Rep. 2020 May 03;3(2):e165
pubmed: 32373717
Trials. 2016 Apr 15;17:187
pubmed: 27079379
JAMA Netw Open. 2021 Nov 1;4(11):e2128898
pubmed: 34724557
BMC Med. 2018 Oct 16;16(1):173
pubmed: 30322399
J Multidiscip Healthc. 2018 Sep 27;11:495-510
pubmed: 30310289
Lancet. 2005 May 28-Jun 3;365(9474):1827-9
pubmed: 15924965
J Clin Epidemiol. 2016 Dec;80:8-15
pubmed: 27498376
JAMA. 2014 Mar 12;311(10):1045-51
pubmed: 24618966
Ann Intern Med. 2013 Feb 5;158(3):200-7
pubmed: 23295957
JAMA. 2003 Jul 23;290(4):516-23
pubmed: 12876095
BMJ Open. 2022 May 24;12(5):e053417
pubmed: 35613804
Eur J Clin Pharmacol. 2016 Oct;72(10):1283-1288
pubmed: 27484242
J Clin Epidemiol. 2020 Mar;119:100-108
pubmed: 31816417
Lancet. 2001 Feb 3;357(9253):373-80
pubmed: 11211013