Most healthcare interventions tested in Cochrane Reviews are not effective according to high quality evidence: a systematic review and meta-analysis.

Epidemiology Evidence Harm Quality Safety Systematic review

Journal

Journal of clinical epidemiology
ISSN: 1878-5921
Titre abrégé: J Clin Epidemiol
Pays: United States
ID NLM: 8801383

Informations de publication

Date de publication:
08 2022
Historique:
received: 24 01 2022
revised: 25 03 2022
accepted: 12 04 2022
pubmed: 22 4 2022
medline: 27 10 2022
entrez: 21 4 2022
Statut: ppublish

Résumé

To estimate the proportion of healthcare interventions tested within Cochrane Reviews that are effective according to high-quality evidence. We selected a random sample of 2,428 (35%) of all Cochrane Reviews published between 1 January 2008 and 5 March 2021. We extracted data about interventions within these reviews that were compared with placebo, or no treatment, and whose outcome quality was rated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. We calculated the proportion of interventions whose benefits were based on high-quality evidence (defined as having high quality GRADE rating for at least one primary outcome, statistically significant positive results, and being judged by review authors as effective. We also calculated the proportion of interventions that suggested harm. Of 1,567 eligible interventions, 87 (5.6%) had high-quality evidence supporting their benefits. Harms were measured for 577 (36.8%) interventions. There was statistically significant evidence for harm in 127 (8.1%) of these. Our dependence on the reliability of Cochrane author assessments (including their GRADE assessments) was the main potential limitation of our study. More than 9 in 10 healthcare interventions studied within recent Cochrane Reviews are not supported by high-quality evidence, and harms are under-reported.

Identifiants

pubmed: 35447356
pii: S0895-4356(22)00100-7
doi: 10.1016/j.jclinepi.2022.04.017
pii:
doi:

Types de publication

Meta-Analysis Systematic Review Journal Article Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

160-169

Informations de copyright

Copyright © 2022 Elsevier Inc. All rights reserved.

Auteurs

Jeremy Howick (J)

Faculty of Philosophy, University of Oxford, Oxford, United Kingdom; Kleijnen Systematic Reviews Ltd., Escrick, York YO19 6FD, United Kingdom. Electronic address: jeremy.howick@philosophy.ox.ac.uk.

Despina Koletsi (D)

(Joint 1(st) author): Clinic of Orthodontics and Pediatric Dentistry, Center of Dental Medicine, University of Zurich, Zurich, Switzerland.

John P A Ioannidis (JPA)

Departments of Medicine, Epidemiology and Population Health, Biomedical Data Science, and Statistics, Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA.

Claire Madigan (C)

Centre for Lifestyle Medicine and Behaviour, Loughborough University, Loughborough, United Kingdom.

Nikolaos Pandis (N)

Department of Orthodontics and Dentofacial Orthopedics, School of Dental Medicine, University of Bern, Bern, Switzerland.

Martin Loef (M)

CHS-Institute, Berlin, Germany.

Harald Walach (H)

CHS-Institute, Berlin, Germany.

Sebastian Sauer (S)

Hochschule Ansbach, Ansbach University, Ansbach, Germany.

Jos Kleijnen (J)

Kleijnen Systematic Reviews Ltd., Escrick, York YO19 6FD, United Kingdom.

Jadbinder Seehra (J)

Centre for Craniofacial Development & Regeneration, Faculty of Dentistry, Oral & Craniofacial Sciences, King's College, London, United Kingdom.

Tess Johnson (T)

Uehiro Centre for Practical Ethics, University of Oxford, Oxford, United Kingdom.

Stefan Schmidt (S)

Department of Psychosomatic Medicine and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany; Institute for Frontier Areas in Psychology and Mental Health, Freiburg, Germany.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH