Evaluation of spin in the abstracts of systematic reviews and meta-analyses related to the treatment of proximal humerus fractures.

orthopedics proximal humerus proximal humerus repair quality of reporting spin systematic review

Journal

Journal of shoulder and elbow surgery
ISSN: 1532-6500
Titre abrégé: J Shoulder Elbow Surg
Pays: United States
ID NLM: 9206499

Informations de publication

Date de publication:
19 Jan 2021
Historique:
received: 09 10 2020
revised: 17 11 2020
accepted: 19 11 2020
entrez: 22 1 2021
pubmed: 23 1 2021
medline: 23 1 2021
Statut: aheadofprint

Résumé

Research has shown that many physicians rely solely on abstracts to make clinical decisions. However, many abstracts have been shown to be misleading. The primary objective of this study was to identify the prevalence of spin - bias towards particular results - within the abstracts of systematic reviews and meta-analyses pertaining to the treatment of proximal humerus fractures, one of the most common osteoporotic fractures among elderly patients. We systematically searched MEDLINE and Embase databases to identify systematic reviews and meta-analyses examining the treatment of proximal humerus fractures. Screening and data extraction occurred in a masked, duplicate fashion. The nine most severe types of spin that occur within abstracts were extracted along with study characteristics, including journal recommendations to adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and year in which the review was performed, to identify potential associations. We subsequently explored the association between spin and the methodological quality of a systematic review using the revised A MeaSurement Tool to Assess systematic Reviews (AMSTAR 2) appraisal instrument. Our search retrieved 505 articles, of which 73 systematic reviews met inclusion criteria. We found that 34.2% (25/73) of the included systematic reviews contained spin. Spin type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention) was the most common type identified (12/73, 16.4%). Three spin types were not identified in any of the abstracts. Spin was 3.2 (OR 3.2; 95% CI, 1.02-10.02) times more likely to be present in systematic reviews published in journals recommending adherence to PRISMA. Furthermore, the odds of an abstract containing spin was 1.25 (OR 1.25; 95% CI, 1.02-1.52) times more likely to be present in systematic reviews for each year after 2000. No other study characteristics were associated with spin. The methodological quality of 24 studies were rated as "critically low" (32.9%), 14 were "low" (19.2%), 28 were "moderate" (38.4%), and 7 were "high" (9.6%), but these findings were not associated with spin. Spin was present in systematic review abstracts regarding treatment of proximal humerus fractures. Measures such as education on the subject of spin and improved reporting standards should be implemented to increase awareness and reduce incidence of spin in abstracts. Basic Science Study; Research Methodology.

Sections du résumé

BACKGROUND BACKGROUND
Research has shown that many physicians rely solely on abstracts to make clinical decisions. However, many abstracts have been shown to be misleading. The primary objective of this study was to identify the prevalence of spin - bias towards particular results - within the abstracts of systematic reviews and meta-analyses pertaining to the treatment of proximal humerus fractures, one of the most common osteoporotic fractures among elderly patients.
METHODS METHODS
We systematically searched MEDLINE and Embase databases to identify systematic reviews and meta-analyses examining the treatment of proximal humerus fractures. Screening and data extraction occurred in a masked, duplicate fashion. The nine most severe types of spin that occur within abstracts were extracted along with study characteristics, including journal recommendations to adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and year in which the review was performed, to identify potential associations. We subsequently explored the association between spin and the methodological quality of a systematic review using the revised A MeaSurement Tool to Assess systematic Reviews (AMSTAR 2) appraisal instrument.
RESULTS RESULTS
Our search retrieved 505 articles, of which 73 systematic reviews met inclusion criteria. We found that 34.2% (25/73) of the included systematic reviews contained spin. Spin type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention) was the most common type identified (12/73, 16.4%). Three spin types were not identified in any of the abstracts. Spin was 3.2 (OR 3.2; 95% CI, 1.02-10.02) times more likely to be present in systematic reviews published in journals recommending adherence to PRISMA. Furthermore, the odds of an abstract containing spin was 1.25 (OR 1.25; 95% CI, 1.02-1.52) times more likely to be present in systematic reviews for each year after 2000. No other study characteristics were associated with spin. The methodological quality of 24 studies were rated as "critically low" (32.9%), 14 were "low" (19.2%), 28 were "moderate" (38.4%), and 7 were "high" (9.6%), but these findings were not associated with spin.
CONCLUSION CONCLUSIONS
Spin was present in systematic review abstracts regarding treatment of proximal humerus fractures. Measures such as education on the subject of spin and improved reporting standards should be implemented to increase awareness and reduce incidence of spin in abstracts.
LEVEL OF EVIDENCE OF THE STUDY PERFORMED UNASSIGNED
Basic Science Study; Research Methodology.

Identifiants

pubmed: 33482369
pii: S1058-2746(21)00016-1
doi: 10.1016/j.jse.2020.11.026
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

2197-2205

Informations de copyright

Copyright © 2021. Published by Elsevier Inc.

Auteurs

Caleb Jones (C)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.

Zane Rulon (Z)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.

Wade Arthur (W)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.

Ryan Ottwell (R)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA. Electronic address: ryan.ottwell@okstate.edu.

Jake Checketts (J)

Department of Orthopedic Surgery, Oklahoma State University Center Medical Center, Tulsa, OK, USA.

Byron Detweiler (B)

Department of Orthopedic Surgery, Oklahoma State University Center Medical Center, Tulsa, OK, USA.

Mark Calder (M)

Orthopedic & Trauma Services of Oklahoma, Tulsa, OK, USA.

Abrar Adil (A)

Orthopedic & Trauma Services of Oklahoma, Tulsa, OK, USA.

Micah Hartwell (M)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.

Drew N Wright (DN)

Samuel J. Wood Library and C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA.

Matt Vassar (M)

Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.

Classifications MeSH