Estimating the prevalence of discrepancies between study registrations and publications: a systematic review and meta-analyses.
clinical trial
registries
statistics & research methods
Journal
BMJ open
ISSN: 2044-6055
Titre abrégé: BMJ Open
Pays: England
ID NLM: 101552874
Informations de publication
Date de publication:
04 10 2023
04 10 2023
Historique:
medline:
2
11
2023
pubmed:
5
10
2023
entrez:
4
10
2023
Statut:
epublish
Résumé
Prospectively registering study plans in a permanent time-stamped and publicly accessible document is becoming more common across disciplines and aims to reduce risk of bias and make risk of bias transparent. Selective reporting persists, however, when researchers deviate from their registered plans without disclosure. This systematic review aimed to estimate the prevalence of undisclosed discrepancies between prospectively registered study plans and their associated publication. We further aimed to identify the research disciplines where these discrepancies have been observed, whether interventions to reduce discrepancies have been conducted, and gaps in the literature. Systematic review and meta-analyses. Scopus and Web of Knowledge, published up to 15 December 2019. Articles that included quantitative data about discrepancies between registrations or study protocols and their associated publications. Each included article was independently coded by two reviewers using a coding form designed for this review (osf.io/728ys). We used random-effects meta-analyses to synthesise the results. We reviewed k=89 articles, which included k=70 that reported on primary outcome discrepancies from n=6314 studies and, k=22 that reported on secondary outcome discrepancies from n=1436 studies. Meta-analyses indicated that between 29% and 37% (95% CI) of studies contained at least one primary outcome discrepancy and between 50% and 75% (95% CI) contained at least one secondary outcome discrepancy. Almost all articles assessed clinical literature, and there was considerable heterogeneity. We identified only one article that attempted to correct discrepancies. Many articles did not include information on whether discrepancies were disclosed, which version of a registration they compared publications to and whether the registration was prospective. Thus, our estimates represent discrepancies broadly, rather than our target of osf.io/ktmdg. Protocol amendments are listed in online supplemental material A.
Identifiants
pubmed: 37793922
pii: bmjopen-2023-076264
doi: 10.1136/bmjopen-2023-076264
pmc: PMC10551944
doi:
Types de publication
Meta-Analysis
Systematic Review
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e076264Subventions
Organisme : Department of Health
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_00011/7
Pays : United Kingdom
Investigateurs
Robert Thibault
(R)
Robbie Clark
(R)
Olmo van den Akker
(OVD)
Samuel Westwood
(S)
Jacqueline M Thompson
(JM)
Marcus R Munafò
(MR)
Informations de copyright
© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY. Published by BMJ.
Déclaration de conflit d'intérêts
Competing interests: None declared.
Références
CMAJ. 2004 Sep 28;171(7):735-40
pubmed: 15451835
N Engl J Med. 2017 Jan 26;376(4):383-391
pubmed: 28121511
J Arthroplasty. 2012 Aug;27(7):1283-8
pubmed: 22226609
BMJ Open. 2011 Jan 1;1(2):e000309
pubmed: 22080540
JAMA. 2013 Nov 27;310(20):2191-4
pubmed: 24141714
Joint Bone Spine. 2012 May;79(3):262-7
pubmed: 21733728
J Clin Epidemiol. 2016 Feb;70:26-37
pubmed: 26226103
J Comp Eff Res. 2019 Nov;8(15):1265-1273
pubmed: 31739691
J Clin Epidemiol. 2017 Nov;91:87-94
pubmed: 28757260
Clin Obes. 2017 Aug;7(4):245-254
pubmed: 28557240
Eur J Orthod. 2019 May 24;41(3):225-230
pubmed: 29992332
J Clin Epidemiol. 2013 Dec;66(12):1367-75
pubmed: 24075598
Lancet. 2008 Jul 19;372(9634):201
pubmed: 18640445
BMJ Open. 2013 Jun 20;3(6):
pubmed: 23794538
R Soc Open Sci. 2022 Jul 27;9(7):220142
pubmed: 35911195
J Clin Epidemiol. 2016 Nov;79:46-54
pubmed: 27079845
BMC Musculoskelet Disord. 2011 Dec 07;12:278
pubmed: 22151841
JAMA Intern Med. 2019 May 1;179(5):624-632
pubmed: 30855655
Psychon Bull Rev. 2014 Oct;21(5):1157-64
pubmed: 24420726
Zhonghua Gan Zang Bing Za Zhi. 2014 Oct;22(10):781-91
pubmed: 25558501
Ann Oncol. 2013 May;24(5):1238-44
pubmed: 23303339
Sci Rep. 2017 Aug 23;7(1):9206
pubmed: 28835682
PLoS One. 2011;6(9):e25258
pubmed: 21957485
Br J Anaesth. 2016 Oct;117(4):542-543
pubmed: 28077557
J Pediatr Psychol. 2019 Oct 1;44(9):1024-1033
pubmed: 31250896
J Clin Epidemiol. 2020 Jan;117:126-137
pubmed: 31654788
Acta Paediatr. 2017 Dec;106(12):1940-1944
pubmed: 28871629
J Psychosom Res. 2015 Jul;79(1):1-12
pubmed: 25956011
JAMA Netw Open. 2019 Nov 1;2(11):e1915360
pubmed: 31722021
J Invest Dermatol. 2012 Dec;132(12):2727-34
pubmed: 22832489
JAMA. 2009 Sep 2;302(9):977-84
pubmed: 19724045
Intensive Care Med. 2014 May;40(5):700-22
pubmed: 24737256
World J Urol. 2020 Nov;38(11):2981-2986
pubmed: 31784773
PLoS Med. 2013;10(1):e1001378
pubmed: 23382656
J Clin Epidemiol. 2019 Feb;106:145-146
pubmed: 30342968
Clin Microbiol Infect. 2018 Nov;24(11):1211.e9-1211.e14
pubmed: 29454846
Am J Sports Med. 2012 Sep;40(9):1970-7
pubmed: 22679295
Perspect Psychol Sci. 2022 Jan;17(1):239-251
pubmed: 33682488
Acta Psychiatr Scand. 2015 Dec;132(6):489-98
pubmed: 26367129
Pain. 2013 Dec;154(12):2769-2774
pubmed: 23962590
Int J Cardiol. 2017 Jan 15;227:299-304
pubmed: 27839821
Hum Reprod. 2017 Oct 1;32(10):2117-2122
pubmed: 28938740
J Eval Clin Pract. 2002 Aug;8(3):353-9
pubmed: 12164983
Trials. 2016 Sep 23;17(1):430
pubmed: 27659549
JAMA Netw Open. 2019 Jul 3;2(7):e197242
pubmed: 31322690
Ann Surg. 2014 Jan;259(1):193-6
pubmed: 23732270
Neurosurgery. 2005 Dec;57(6):1244-53; discussion 1244-53
pubmed: 16331173
J Clin Epidemiol. 2015 May;68(5):510-7
pubmed: 25450451
Anesth Analg. 2017 Oct;125(4):1292-1300
pubmed: 28704247
Arthritis Rheum. 2012 Jul;64(7):2059-67
pubmed: 22275179
BMJ. 2008 Dec 04;337:a2299
pubmed: 19056791
Trials. 2019 Feb 14;20(1):118
pubmed: 30760329
JAMA. 2017 Nov 7;318(17):1709-1711
pubmed: 28892118
Ann Surg. 2013 May;257(5):818-23
pubmed: 23407296
Trials. 2015 Jan 27;16:28
pubmed: 25626862
PLoS One. 2015 Aug 19;10(8):e0133718
pubmed: 26287998
BMJ. 2004 Jan 3;328(7430):22-4
pubmed: 14703540
JAMA Otolaryngol Head Neck Surg. 2019 May 01;145(5):468-474
pubmed: 30920611
J R Stat Soc Ser A Stat Soc. 2009 Jan;172(1):137-159
pubmed: 19381330
PLoS One. 2013 Jul 05;8(7):e66844
pubmed: 23861749
N Engl J Med. 2004 Sep 16;351(12):1250-1
pubmed: 15356289
BMC Med Res Methodol. 2018 Jan 11;18(1):9
pubmed: 29325533
J Clin Epidemiol. 2012 Jun;65(6):602-9
pubmed: 22424985
N Engl J Med. 2009 Nov 12;361(20):1963-71
pubmed: 19907043
BMJ. 2014 Jun 04;348:g3510
pubmed: 24899650
Anticancer Res. 2017 Sep;37(9):5101-5107
pubmed: 28870940
BMJ. 2011 Feb 10;342:d549
pubmed: 21310794
PLoS One. 2015 May 21;10(5):e0127495
pubmed: 25996928
BMJ Open. 2016 Jul 12;6(7):e010247
pubmed: 27406637
Am J Epidemiol. 2011 Jul 15;174(2):219-25
pubmed: 21597099
PLoS Med. 2008 Nov 25;5(11):e217; discussion e217
pubmed: 19067477
J Bone Joint Surg Am. 2016 Mar 2;98(5):403-9
pubmed: 26935463
JRSM Open. 2014 Apr 09;5(5):2042533313517688
pubmed: 25057391
R Soc Open Sci. 2020 Feb 19;7(2):190806
pubmed: 32257301
BMC Med. 2015 Nov 18;13:282
pubmed: 26581191
J Clin Epidemiol. 2018 Dec;104:95-102
pubmed: 30196127
J Clin Periodontol. 2019 Jul;46(7):758-765
pubmed: 31077411
Eur J Obstet Gynecol Reprod Biol. 2019 May;236:58-68
pubmed: 30884337
Clin Chem. 2017 Aug;63(8):1331-1341
pubmed: 28630237
Phys Ther. 2013 Mar;93(3):299-309
pubmed: 23125281
Perspect Clin Res. 2017 Oct-Dec;8(4):167-171
pubmed: 29109933
PLoS One. 2017 Jun 1;12(6):e0178379
pubmed: 28570573
Ann Surg. 2013 Jun;257(6):1007-15
pubmed: 23478520
PLoS One. 2015 Aug 05;10(8):e0132382
pubmed: 26244868
BMJ Open. 2022 Sep 28;12(9):e066624
pubmed: 36171034
Lancet. 2006 May 20;367(9523):1631-3
pubmed: 16714166
PLoS One. 2017 Jul 20;12(7):e0180986
pubmed: 28727834
Invest New Drugs. 2017 Dec;35(6):827-833
pubmed: 28905282
Ann Intern Med. 2016 Mar 1;164(5):374-5
pubmed: 26720499
Acta Psychiatr Scand. 2017 Jan;135(1):65-77
pubmed: 27690210
Ann Intern Med. 2014 Apr 1;160(7):477-83
pubmed: 24687070
BMJ. 2013 Jul 12;347:f4313
pubmed: 23851720
J Clin Oncol. 2012 Jan 10;30(2):210-6
pubmed: 22162583
JAMA. 2015 Mar 17;313(11):1163-5
pubmed: 25781447
Ann Emerg Med. 2012 Oct;60(4):458-64.e1
pubmed: 22503374
JAMA. 2004 May 26;291(20):2457-65
pubmed: 15161896
J Allergy Clin Immunol. 2014 Dec;134(6):1443-1446
pubmed: 25441299
J Clin Oncol. 2015 Nov 1;33(31):3583-90
pubmed: 26304898
BMJ Open. 2018 Feb 8;8(2):e019831
pubmed: 29439079
Res Synth Methods. 2014 Sep;5(3):273-84
pubmed: 26052852
PLoS One. 2019 Oct 3;14(10):e0223305
pubmed: 31581278
PLoS One. 2015 Sep 14;10(9):e0137667
pubmed: 26368938
BMJ. 2014 Jul 16;349:g4539
pubmed: 25030633
Scand J Gastroenterol. 2013 Dec;48(12):1474-83
pubmed: 24131272
Ann Fam Med. 2009 Nov-Dec;7(6):542-6
pubmed: 19901314