LOCATE: a prospective evaluation of the value of Leveraging Ongoing Citation Acquisition Techniques for living Evidence syntheses.

Humans Prospective Studies PubMed
Evidence synthesis Evidence-based medicine Knowledge synthesis Literature searching Living systematic review Methods Systematic review Updating

Journal

Systematic reviews
ISSN: 2046-4053
Titre abrégé: Syst Rev
Pays: England
ID NLM: 101580575

Informations de publication

Date de publication:
19 04 2021
Historique:
received: 13 10 2020
accepted: 05 04 2021
entrez: 20 4 2021
pubmed: 21 4 2021
medline: 6 7 2021
Statut: epublish

Résumé

Living systematic reviews (LSRs) can expedite evidence synthesis by incorporating new evidence in real time. However, the methods needed to identify new studies in a timely manner are not well established. To explore the value of complementary search approaches in terms of search performance, impact on results and conclusions, screening workload, and feasibility compared to the reference standard. We developed three complementary search approaches for a systematic review on treatments for bronchiolitis: Automated Full Search, PubMed Similar Articles, and Scopus Citing References. These were automated to retrieve results monthly; pairs of reviewers screened the records and commented on feasibility. After 1 year, we conducted a full update search (reference standard). For each complementary approach, we compared search performance (proportion missed, number needed to read [NNR]) and reviewer workload (number of records screened, time required) to the reference standard. We investigated the impact of the new trials on the effect estimate and certainty of evidence for the primary outcomes. We summarized comments about feasibility. Via the reference standard, reviewers screened 505 titles/abstracts, 24 full texts, and identified four new trials (NNR 127; 12.4 h). Of the complementary approaches, only the Automated Full Search located all four trials; these were located 6 to 12 months sooner than via the reference standard but did not alter the results nor certainty in the evidence. The Automated Full Search was the most resource-intensive approach (816 records screened; NNR 204; 17.1 h). The PubMed Similar Articles and Scopus Citing References approaches located far fewer records (452 and 244, respectively), thereby requiring less screening time (9.4 and 5.2 h); however, each approach located only one of the four new trials. Reviewers found it feasible and convenient to conduct monthly screening for searches of this yield (median 15-65 records/month). The Automated Full Search was the most resource-intensive approach, but also the only to locate all of the newly published trials. Although the monthly screening time for the PubMed Similar Articles and Scopus Citing Articles was far less, most relevant records were missed. These approaches were feasible to integrate into reviewer work processes. Open Science Framework. https://doi.org/10.17605/OSF.IO/6M28H .

Sections du résumé

BACKGROUND
Living systematic reviews (LSRs) can expedite evidence synthesis by incorporating new evidence in real time. However, the methods needed to identify new studies in a timely manner are not well established.
OBJECTIVES
To explore the value of complementary search approaches in terms of search performance, impact on results and conclusions, screening workload, and feasibility compared to the reference standard.
METHODS
We developed three complementary search approaches for a systematic review on treatments for bronchiolitis: Automated Full Search, PubMed Similar Articles, and Scopus Citing References. These were automated to retrieve results monthly; pairs of reviewers screened the records and commented on feasibility. After 1 year, we conducted a full update search (reference standard). For each complementary approach, we compared search performance (proportion missed, number needed to read [NNR]) and reviewer workload (number of records screened, time required) to the reference standard. We investigated the impact of the new trials on the effect estimate and certainty of evidence for the primary outcomes. We summarized comments about feasibility.
RESULTS
Via the reference standard, reviewers screened 505 titles/abstracts, 24 full texts, and identified four new trials (NNR 127; 12.4 h). Of the complementary approaches, only the Automated Full Search located all four trials; these were located 6 to 12 months sooner than via the reference standard but did not alter the results nor certainty in the evidence. The Automated Full Search was the most resource-intensive approach (816 records screened; NNR 204; 17.1 h). The PubMed Similar Articles and Scopus Citing References approaches located far fewer records (452 and 244, respectively), thereby requiring less screening time (9.4 and 5.2 h); however, each approach located only one of the four new trials. Reviewers found it feasible and convenient to conduct monthly screening for searches of this yield (median 15-65 records/month).
CONCLUSIONS
The Automated Full Search was the most resource-intensive approach, but also the only to locate all of the newly published trials. Although the monthly screening time for the PubMed Similar Articles and Scopus Citing Articles was far less, most relevant records were missed. These approaches were feasible to integrate into reviewer work processes.
SYSTEMATIC REVIEW REGISTRATION
Open Science Framework. https://doi.org/10.17605/OSF.IO/6M28H .

Identifiants

DOI: 10.1186/s13643-021-01665-x PMID: 33875014 PMC: PMC8056603
pubmed: 33875014
doi: 10.1186/s13643-021-01665-x
pii: 10.1186/s13643-021-01665-x
pmc: PMC8056603
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't Systematic Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

116

Références

BMC Med Res Methodol. 2011 Jun 17;11:92
pubmed: 21682870
Pediatr Pulmonol. 2018 Mar;53(3):358-365
pubmed: 29327810
J Clin Epidemiol. 2017 Aug;88:148-153
pubmed: 28625563
J Clin Epidemiol. 2016 Jul;75:40-6
pubmed: 27005575
J Infect Dis. 2020 Oct 7;222(Suppl 7):S672-S679
pubmed: 31541233
J Clin Epidemiol. 2017 Nov;91:31-37
pubmed: 28912003
BMC Med. 2016 Jan 20;14:8
pubmed: 26792360
J Clin Epidemiol. 2017 Nov;91:38-46
pubmed: 28912004
J Clin Epidemiol. 2017 Nov;91:23-30
pubmed: 28912002
BMJ. 2011 Oct 18;343:d5928
pubmed: 22008217
An Pediatr (Barc). 2019 Jan;90(1):3-9
pubmed: 29627312
Syst Rev. 2015 Nov 12;4:160
pubmed: 26563648
Pediatr Pulmonol. 2019 May;54(5):620-627
pubmed: 30887708
Syst Rev. 2019 Dec 14;8(1):325
pubmed: 31837703
Control Clin Trials. 1986 Sep;7(3):177-88
pubmed: 3802833
J Clin Epidemiol. 2018 Jul;99:53-63
pubmed: 29526555
BMJ. 2008 Apr 26;336(7650):924-6
pubmed: 18436948
Acta Paediatr. 2019 Jun;108(6):1016-1022
pubmed: 30614550
Syst Rev. 2019 Jun 18;8(1):143
pubmed: 31215463
BMC Bioinformatics. 2007 Oct 30;8:423
pubmed: 17971238
Cochrane Database Syst Rev. 2012 Nov 14;12:ED000048
pubmed: 23235688
BMJ Open. 2017 Feb 27;7(2):e012545
pubmed: 28242767
PLoS Med. 2014 Feb 18;11(2):e1001603
pubmed: 24558353
PLoS One. 2008;3(11):e3684
pubmed: 18997866
Ann Intern Med. 2007 Aug 21;147(4):224-33
pubmed: 17638714
Semin Nucl Med. 2019 Mar;49(2):136-144
pubmed: 30819393
Eur J Pediatr. 2018 Aug;177(8):1299-1307
pubmed: 29915869

Auteurs

Michelle Gates (M)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-486C Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada. mgates1@ualberta.ca.
ORCID: 0000-0002-9941-9981

Sarah A Elliott (SA)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-488A Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada.

Allison Gates (A)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-482C Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada.

Meghan Sebastianski (M)

Alberta Strategy for Patient-Oriented Research (SPOR) SUPPORT Unit Knowledge Translation Platform, Department of Pediatrics, University of Alberta, 4-486D Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6H 1C9, Canada.

Jennifer Pillay (J)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-488D Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada.

Liza Bialy (L)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-486A Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada.

Lisa Hartling (L)

Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, 4-472 Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta, T6G 1C9, Canada.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female

Evaluation of Low-Value Services Across Major Medicare Advantage Insurers and Traditional Medicare.

Ciara Duggan, Adam L Beckman, Ishani Ganguli et al.
1.00
Humans United States Aged Cross-Sectional Studies Medicare Part C

Effectiveness of Virtual Yoga for Chronic Low Back Pain: A Randomized Clinical Trial.

Hallie Tankha, Devyn Gaskins, Amanda Shallcross et al.
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH

questionsmedicales.fr › Eucaryotes › Animaux › Chordés › Vertébrés › Mammifères › Eutheria › Primates › Haplorhini › Catarrhini › Hominidae › Humains › LOCATE: a prospective evaluation of the value...
questionsmedicales.fr › Environnement et santé publique › Santé publique › Méthodes épidémiologiques › Caractéristiques des études épidémiologiques › Études épidémiologiques › Études de cohortes › Études prospectives › LOCATE: a prospective evaluation of the value...
questionsmedicales.fr › Sciences de l'information › Mémorisation et recherche des informations › Bases de données comme sujet › Bases de données bibliographiques › PubMed › LOCATE: a prospective evaluation of the value...