Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis.


Journal

PLoS medicine
ISSN: 1549-1676
Titre abrégé: PLoS Med
Pays: United States
ID NLM: 101231360

Informations de publication

Date de publication:
04 2022
Historique:
received: 07 12 2021
accepted: 01 04 2022
revised: 11 05 2022
pubmed: 28 4 2022
medline: 18 5 2022
entrez: 27 4 2022
Statut: epublish

Résumé

We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations. We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.

Sections du résumé

BACKGROUND
We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs.
METHODS AND FINDINGS
We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations.
CONCLUSIONS
We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.

Identifiants

pubmed: 35476675
doi: 10.1371/journal.pmed.1003980
pii: PMEDICINE-D-21-05025
pmc: PMC9094518
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

e1003980

Déclaration de conflit d'intérêts

I have read the journal’s policy and the authors of this manuscript have the following competing interests: DG contributed to the ASPIRE project as part of his PhD thesis before his current employment with Idorsia Pharmaceuticals Ltd. (his current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). BvN contributed to the ASPIRE project as part of her PhD thesis before her current employment with Roche (her current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). All authors have declared that no competing interests exist.

Références

JAMA. 2010 May 26;303(20):2058-64
pubmed: 20501928
BMJ. 2020 Apr 14;369:m982
pubmed: 32291261
BMJ Open. 2015 May 05;5(5):e006666
pubmed: 25943371
Clin Trials. 2008;5(1):40-8
pubmed: 18283079
Lancet. 2014 Jan 18;383(9913):257-66
pubmed: 24411650
Trials. 2019 Feb 14;20(1):118
pubmed: 30760329
Trials. 2020 Oct 28;21(1):896
pubmed: 33115541
BMJ. 2013 Jan 08;346:e7586
pubmed: 23303884
Trials. 2018 Aug 23;19(1):448
pubmed: 30134950
JAMA. 2004 May 26;291(20):2457-65
pubmed: 15161896
PLoS One. 2014 Dec 23;9(12):e114023
pubmed: 25536072
Swiss Med Wkly. 2008 Apr 5;138(13-14):197-203
pubmed: 18389392
J Clin Epidemiol. 2021 Nov;139:340-349
pubmed: 34029678
Health Sci Rep. 2020 May 03;3(2):e165
pubmed: 32373717
Trials. 2016 Apr 15;17:187
pubmed: 27079379
JAMA Netw Open. 2021 Nov 1;4(11):e2128898
pubmed: 34724557
BMC Med. 2018 Oct 16;16(1):173
pubmed: 30322399
J Multidiscip Healthc. 2018 Sep 27;11:495-510
pubmed: 30310289
Lancet. 2005 May 28-Jun 3;365(9474):1827-9
pubmed: 15924965
J Clin Epidemiol. 2016 Dec;80:8-15
pubmed: 27498376
JAMA. 2014 Mar 12;311(10):1045-51
pubmed: 24618966
Ann Intern Med. 2013 Feb 5;158(3):200-7
pubmed: 23295957
JAMA. 2003 Jul 23;290(4):516-23
pubmed: 12876095
BMJ Open. 2022 May 24;12(5):e053417
pubmed: 35613804
Eur J Clin Pharmacol. 2016 Oct;72(10):1283-1288
pubmed: 27484242
J Clin Epidemiol. 2020 Mar;119:100-108
pubmed: 31816417
Lancet. 2001 Feb 3;357(9253):373-80
pubmed: 11211013

Auteurs

Benjamin Speich (B)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Dmitry Gryaznov (D)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Jason W Busse (JW)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Department of Anesthesia, McMaster University, Hamilton, Canada.

Viktoria L Gloy (VL)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Szimonetta Lohner (S)

Cochrane Hungary, Clinical Centre of the University of Pécs, Medical School, University of Pécs, Pécs, Hungary.
Department of Public Health Medicine, Medical School, University of Pécs, Pécs, Hungary.

Katharina Klatte (K)

Clinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.

Ala Taji Heravi (A)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Swiss Tropical and Public Health Institute, Basel, Switzerland.

Nilabh Ghosh (N)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Hopin Lee (H)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Anita Mansouri (A)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Ioana R Marian (IR)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Ramon Saccilotto (R)

Clinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.

Edris Nury (E)

Institute for Evidence in Medicine (for Cochrane Germany Foundation), Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany.
Department of General Practice and Primary Care, Medical Center Hamburg-Eppendorf-UKE, Hamburg, Germany.

Benjamin Kasenda (B)

Department of Medical Oncology, University of Basel and University Hospital Basel, Basel, Switzerland.

Elena Ojeda-Ruiz (E)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Bioaraba Health Research Institute, Health Prevention, Promotion and Care Area; Osakidetza Basque Health Service, Araba University Hospital, Preventive Medicine Department, Vitoria-Gasteiz, Spain.

Stefan Schandelmaier (S)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.

Yuki Tomonaga (Y)

Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.

Alain Amstutz (A)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Swiss Tropical and Public Health Institute, Basel, Switzerland.
Department of Infectious Diseases and Hospital Epidemiology, University Hospital Basel, Basel, Switzerland.

Christiane Pauli-Magnus (C)

Clinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.

Karin Bischoff (K)

Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany.

Katharina Wollmann (K)

Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany.

Laura Rehner (L)

Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
Institute for Nursing Science and Interprofessional Learning, University Medicine Greifswald, Greifswald, Germany.

Joerg J Meerpohl (JJ)

Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany.

Alain Nordmann (A)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Jacqueline Wong (J)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.

Ngai Chow (N)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.

Patrick Jiho Hong (PJ)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, Canada.

Kimberly Mc Cord-De Iaco (K)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Multifactorial and Complex Diseases Research Area, Bambino Gesù Children's Hospital IRCCS, Rome, Italy.

Sirintip Sricharoenchai (S)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Arnav Agarwal (A)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Division of General Internal Medicine, Department of Medicine, McMaster University, Hamilton, Ontario, Canada.

Matthias Schwenkglenks (M)

Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.
Institute of Pharmaceutical Medicine (ECPM), University of Basel, Basel, Switzerland.

Lars G Hemkens (LG)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Meta-Research Innovation Center Berlin (METRICS-B), Berlin Institute of Health, Berlin, Germany.
Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, United States of America.

Erik von Elm (E)

Cochrane Switzerland, Centre for Primary Care and Public Health (Unisanté), University of Lausanne, Lausanne, Switzerland.

Bethan Copsey (B)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Alexandra N Griessbach (AN)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Christof Schönenberger (C)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.

Dominik Mertz (D)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Department of Medicine, McMaster University, Hamilton, Canada.

Anette Blümle (A)

Swiss Tropical and Public Health Institute, Basel, Switzerland.
Clinical Trials Unit, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany.

Belinda von Niederhäusern (B)

Department of Public Health Medicine, Medical School, University of Pécs, Pécs, Hungary.
Roche Pharma AG, Grenzach-Wyhlen, Germany.

Sally Hopewell (S)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Ayodele Odutayo (A)

Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Applied Health Research Centre, Li Ka Shing Knowledge Institute of St Michael's Hospital, Toronto, Ontario, Canada.

Matthias Briel (M)

Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH