The NICE UK geographic search filters for MEDLINE and Embase (Ovid): Post-development study to further evaluate precision and number-needed-to-read when retrieving UK evidence.
Journal
Research synthesis methods
ISSN: 1759-2887
Titre abrégé: Res Synth Methods
Pays: England
ID NLM: 101543738
Informations de publication
Date de publication:
Sep 2020
Sep 2020
Historique:
received:
06
02
2020
revised:
28
05
2020
accepted:
26
06
2020
pubmed:
4
7
2020
medline:
3
8
2021
entrez:
4
7
2020
Statut:
ppublish
Résumé
The National Institute for Health and Care Excellence's (NICE) United Kingdom (UK) geographic search filters for MEDLINE and Embase (OVID) retrieve evidence in literature searches for UK-focused research topics with high recall. Their precision and number-needed-to-read (NNR) was examined previously in case studies using a single review. This paper details a larger post-development study that was conducted to test the NICE UK filters' precision and NNR more extensively. The filters' recall of included UK references from 100 reviews was calculated. As reproducible search strategies were not available for every review, the MEDLINE filter's precision and NNR were calculated using strategies from 25 reviews. Strategies from nine reviews were used for the Embase filter. The MEDLINE filter achieved an average of 96.4% recall for the included UK references from the 100 reviews and the Embase filter achieved an average of 97.4% recall. Compared to not using a filter, the MEDLINE filter achieved an average of 98.9% recall for the 25 reviews. Precision was increased by an average of 7.8 times, reducing the NNR from 357 to 46. The Embase filter achieved an average of 97.1% recall for the nine reviews. Precision was increased by an average of 5.1 times, reducing the NNR from 746 to 146. There is more evidence to demonstrate that the NICE UK filters retrieve the majority of UK evidence from MEDLINE and Embase while increasing precision and reducing NNR. The filters can save time spent on selecting evidence for UK-focused research topics.
Sections du résumé
BACKGROUND
BACKGROUND
The National Institute for Health and Care Excellence's (NICE) United Kingdom (UK) geographic search filters for MEDLINE and Embase (OVID) retrieve evidence in literature searches for UK-focused research topics with high recall. Their precision and number-needed-to-read (NNR) was examined previously in case studies using a single review. This paper details a larger post-development study that was conducted to test the NICE UK filters' precision and NNR more extensively.
METHODS
METHODS
The filters' recall of included UK references from 100 reviews was calculated. As reproducible search strategies were not available for every review, the MEDLINE filter's precision and NNR were calculated using strategies from 25 reviews. Strategies from nine reviews were used for the Embase filter.
RESULTS
RESULTS
The MEDLINE filter achieved an average of 96.4% recall for the included UK references from the 100 reviews and the Embase filter achieved an average of 97.4% recall. Compared to not using a filter, the MEDLINE filter achieved an average of 98.9% recall for the 25 reviews. Precision was increased by an average of 7.8 times, reducing the NNR from 357 to 46. The Embase filter achieved an average of 97.1% recall for the nine reviews. Precision was increased by an average of 5.1 times, reducing the NNR from 746 to 146.
CONCLUSION
CONCLUSIONS
There is more evidence to demonstrate that the NICE UK filters retrieve the majority of UK evidence from MEDLINE and Embase while increasing precision and reducing NNR. The filters can save time spent on selecting evidence for UK-focused research topics.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
669-677Informations de copyright
© 2020 John Wiley & Sons, Ltd.
Références
Glanville J, Bayliss S, Booth A, et al. So many filters, so little time: the development of a search filter appraisal checklist. J Med Libr Assoc. 2008;96:356-361. https://doi.org/10.3163/1536-5050.96.4.011.
Bachmann L, Coray R, Estermann P, Ter Riet G. Identifying diagnostic studies in MEDLINE: reducing the number needed to read. J Am Med Inform Assoc. 2002;9:653-658. https://doi.org/10.1197/jamia.M1124.
Polanin JR, Pigott TD, Espelage DL, Grotpeter JK. Best practice guidelines for abstract screening large-evidence systematic reviews and meta-analyses. Res Synth Methods. 2019;10(3):330-342. https://doi.org/10.1002/jrsm.1354.
Ayiku L, Levay P, Hudson T, et al. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UKfrom OVID MEDLINE. Health Info Libr J. 2017;34(3):200-216. https://doi.org/10.1111/hir.12187.
Ayiku L, Levay P, Hudson T, et al. The Embase UK filter: validation of a geographic search filter to retrieve research about the UK from OVID Embase. Health Info Libr J. 2019;26(2):121-133. https://doi.org/10.1111/hir.12252.
Sampson M, Zhang L, Morrison A, et al. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006;6:33. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1557524/.
Brooks N, Anthony D. Clinical guidelines in community hospitals. Nurs Standard. 2000;15(1):35-39. https://doi.org/10.7748/ns2000.09.15.1.35.c2920.
Williams J, Last S. Intermediate care: smoothing the road to recovery. Nurs Times. 1998;94(49):52-54. https://www.ncbi.nlm.nih.gov/pubmed/10036544?dopt=Abstract&holding=f1000,f1000m,isrctn.
Homer AC, Gilleard CJ. The effect of inpatient respite care on elderly patients and their carers. Age Ageing. 1994;23(4):274-276. https://doi.org/10.1093/ageing/23.4.274.
Mabrook AF, Dale B. Can nurse practitioners offer a quality service? An evaluation of a year's work of a nurse led minor injury unit. J Accid Emerg Med. 1998;15(4):266-268. https://doi.org/10.1136/emj.15.4.266.
Durand-Zaleski I, Earlam S, Fordy C, Davies M, Allen-Mersh TG. Cost-effectiveness of systemic and regional chemotherapy for the treatment of patients with unresectable colorectal liver metastases. Cancer. 1998;83(5):882-888. https://doi.org/10.1002/(SICI)1097-0142(19980901)83:5<882::AID-CNCR12>3.0.CO;2-R.
Bowers B, Roderick S, Arnold S. Improving integrated team working to support people to die in the place of their choice. Nurs Times. 2010;106(32):14-16. https://www.nursingtimes.net/clinical-archive/end-of-life-and-palliative-care/improving-integrated-team-working-to-support-people-to-die-in-the-place-of-their-choice-/5018285.article.
Marshall K, Nelson S, Sykes C. Analysing and improving a rapid-access chest pain clinic. Nurs Times. 2005;101(41):32-33. https://www.nursingtimes.net/clinical-archive/pain-management/analysing-and-improving-a-rapid-access-chest-pain-clinic/203639.article.
Beynon R, Leeflang MM, McDonald S, et al. Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev. 2013;(9):Mr000022. https://doi.org/10.1002/14651858.mr000022.pub3.
Lefebvre C, Glanville J, Briscoe S, et al. Chapter 4: searching for and selecting studies. In: Higgins JPT, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. London: Cochrane Collaboration; 2019. https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119536604.ch4.
Krska J, Mackridge AJ. Involving the public and other stakeholders in development and evaluation of a community pharmacy alcohol screening and brief advice service. Public Health. 2014;128(4):309-316. https://doi.org/10.1016/j.puhe.2013.11.001.
Schneider J, Hallam A, Murray J, et al. Formal and informal care for people with dementia: factors associated with service receipt. Aging Ment Health. 2002;6(3):255-265. https://doi.org/10.1080/13607860220142486.
Carroll R, Ali N, Azam N. Promoting physical activity in South Asian Muslim women through exercise on prescription. Health Technol Assess. 2002;6(8):1-101. http://www.crd.york.ac.uk/crdweb/PrintPDF.php?AccessionNumber=32002000365&Copyright=Health+Technology+Assessment+%28HTA%29+database%3Cbr+%2F%3ECopyright+%26copy%3B+2009+Queen%27s+Printer+and+Controller+of+HMSO%3Cbr+%2F%3E.
Cooper J, Murphy E, Webb R, Hawton K. Ethnic differences in self-harm, rates, characteristics and service provision: three-city cohort study. Br J Psychiatry. 2010;197(3):212-218. https://doi.org/10.1192/bjp.bp.109.072637.
Khanam S, Costarelli V. Attitudes towards health and exercise of overweight women. J R Soc Promot Health. 2008;128(1):26-30. https://doi.org/10.1177/1466424007085225.
Kingsbury S. The psychological and social characteristics of Asian adolescent overdose. J Adolesc. 1994;17(2):131-135. https://doi.org/10.1006/jado.1994.1013.
McKeigue PM, Marmot MG, Syndercombe Court YD, Cottier DE, Rahman S, Riemersma RA. Diabetes, hyperinsulinaemia, and coronary risk factors in Bangladeshis in East London. Br Heart J. 1988;60(5):390-396. https://doi.org/10.1136/hrt.60.5.390.
McKeigue PM, Shah B, Marmot MG. Relation of central obesity and insulin resistance with high diabetes prevalence and cardiovascular risk in South Asians. Lancet. 1991;337(8738):382-386. https://doi.org/10.1016/0140-6736(91)91164-P.
Michel G, Silverman M, Strippoli MPF, et al. Parental understanding of wheeze and its impact on asthma prevalence estimates. Eur Respir J. 2006;28(6):1124-1130. https://doi.org/10.1183/09031936.06.00008406.
Miller GJ, Kotecha S, Wilkinson WH, et al. Dietary and other characteristics relevant for coronary heart disease in men of Indian, West Indian and European descent in London. Atherosclerosis. 1988;70(1-2):63-72. https://doi.org/10.1016/0021-9150(88)90100-1.
Panico L, Bartley M, Marmot M, Nazroo J, Sacker A, Kelly YJ. Ethnic variation in childhood asthma and wheezing illnesses: findings from the millennium cohort study. Int J Epidemiol. 2007;36(5):1093-1102. https://doi.org/10.1093/ije/dym089.
Whitty CJM, Brunner EJ, Shipley MJ, Hemingway H, Marmot MG. Differences in biological risk factors for cardiovascular disease between three ethnic groups in the Whitehall II study. Atherosclerosis. 1999;142(2):279-286. https://doi.org/10.1016/S0021-9150(98)00239-1.
Gasparrini A, Guo Y, Hashizume M, et al. Mortality risk attributable to high and low ambient temperature: a multicountry observational study. Lancet. 2015;386(9991):369-375. https://doi.org/10.1016/S0140-6736(14)62114-0.
Salvador-Oliván JA, Marco-Cuenca G, Arquero-Avilés R. Errors in search strategies used in systematic reviews and their effects on information retrieval. J Med Libr Assoc. 2019;107(2):210-221. https://doi.org/10.5195/jmla.2019.567.
Koffel JB, Rethlefsen ML. Reproducibility of search strategies is poor in systematic reviews published in high-impact pediatrics, cardiology and surgery journals: a cross-sectional study. PLOS One. 2016;11(9):e0163309. https://doi.org/10.1371/journal.pone.0163309.
Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1). https://doi.org/10.1186/2046-4053-4-1.
Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. https://doi.org/10.7326/M18-0850.
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40-46. https://doi.org/10.1016/j.jclinepi.2016.01.021.
Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a geographic search filter to identify randomised controlled trials in Africa: finding the optimal balance between sensitivity and precision. Health Info Libr J. 2011;28:210-215. https://doi.org/10.1111/j.1471-1842.2011.00936.x.
Valderas J, Mendivil J, Parada A, Losada-Yáñez M, Alonso J. Development of a geographic filter for PubMed to identify studies performed in Spain. Rev Esp Cardiol. 2006;59:1244-1251. https://doi.org/10.1016/S1885-5857(07)60080-2.
Ayiku L, Craven J, Hudson T, Levay P. How to develop a validated geographic search filter: five key steps. Evid Based Libr Inf Pract. 2020;15(1):170-178. https://doi.org/10.18438/eblip29633.