The trends for the "trend toward significance" in the pediatric literature.
Interpretation
Statistical significance
Trend
p Value
Journal
European journal of pediatrics
ISSN: 1432-1076
Titre abrégé: Eur J Pediatr
Pays: Germany
ID NLM: 7603873
Informations de publication
Date de publication:
Feb 2023
Feb 2023
Historique:
received:
20
09
2022
accepted:
28
11
2022
revised:
08
11
2022
pubmed:
3
12
2022
medline:
8
2
2023
entrez:
2
12
2022
Statut:
ppublish
Résumé
Purpose This study is to examine whether the term "trend toward statistical significance" is used to describe statistically nonsignificant results in biomedical literature. We examined articles published in five high-impact pediatric journals, including The Lancet Child & Adolescent Health, The Journal of Pediatrics, Early Human Development, Frontiers in Pediatrics, and BMC Pediatrics to identify manuscripts where a "trend" was used to describe a statistically nonsignificant result, from January 2020 to December 2021, and, furthermore, for The Journal of Pediatrics, Early Human Development, and BMC Pediatrics from January 2010 to December 2011. We detected that a "trend toward significance" was used to describe a statistically nonsignificant result at least once in 146 articles (2.7%) during the period between 2020 and 2021 and in 97 articles (4.0%) during the period between 2010 and 2011. We found no significant difference in the proportion of published articles with inappropriate use of "trend" across journals belonging to the first quartile of impact compared to the second quartile or across journals publishing under the subscription model or open access policy compared to journals publishing solely under the open access policy, in any period. The overall proportion of the inappropriate use of "trend" declined significantly between 2010 and 2011 to 2020 and 2021 (p = 0.002, RR 0.66 95% CI 0.51-0.86). "Trend" statements were sporadically used to describe statistically nonsignificant results across pediatric literature. The inappropriate use of "trend" to describe almost significant differences could be misleading, and "trend" should be reserved only when a specific statistical test for trend has been performed, or in relation to appropriate scientific definitions. •Previously, researchers have reported inappropriate use of "trend" in articles across anaesthesia or major oncology journals. •In many cases, hypothesized results that are close but not lower than the statistical significance threshold are emphasized as "almost" significant. •"Trend" statements were sporadically used to describe statistically nonsignificant results across pediatric literature. •Inappropriate use of "trend" was similar in journals with a subscription model compared to those having an open access policy and decreased within a 10-year period.
Identifiants
pubmed: 36459228
doi: 10.1007/s00431-022-04746-8
pii: 10.1007/s00431-022-04746-8
pmc: PMC9899178
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
937-940Informations de copyright
© 2022. The Author(s).
Références
Nead KT, Wehner MR, Mitra N (2018) The use of “trend” statements to describe statistically nonsignificant results in the oncology literature. JAMA Oncol 4:1778–1779
doi: 10.1001/jamaoncol.2018.4524
Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, Hing C, Kwok CS, Pang C, Harvey I (2010) Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess 14:iii, ix-xi, 1–193
Gibbs NM, Gibbs SV (2015) Misuse of ‘trend’ to describe ‘significant’ differences in anaesthesia research. Br J Anaesth 115:337–339
doi: 10.1093/bja/aev149
Wood J, Freemantle N, King M, Nazareth I (2014) Trap of trends to statistical significance: likelihood of near significant P value becoming more significant with extra data. BMJ 348:g2215
doi: 10.1136/bmj.g2215
Cochran WG (1954) Some methods for strengthening the common χ 2 tests. Biometrics 10
Armitage P (1955) Tests for linear trends in proportions and frequencies. Biometrics 11
Thomas E (2005) An introduction to medical statistics for health care professionals: basic statistical tests. Musculoskeletal Care 3:201–212
doi: 10.1002/msc.11
SCImago, (n.d.). SJR — SCImago Journal & Country Rank [Portal]. https://www.scimagojr.com/journalrank.php?category=2735 . Accessed 01 Mar 2022
Arnold LD, Braganza M, Salih R, Colditz GA (2013) Statistical trends in the Journal of the American Medical Association and implications for training across the continuum of medical education. PLoS ONE 8:e77301
doi: 10.1371/journal.pone.0077301
Morgan CJ (2018) Balancing statistical significance and clinical relevance. J Nucl Cardiol 25:707–708
doi: 10.1007/s12350-018-1267-y
Wasserstein RL, Lazar NA (2016) The ASA statement on p-values: context, process, and purpose. Am Stat 70:129–133
doi: 10.1080/00031305.2016.1154108