Rapid evaluation of service innovations in health and social care: key considerations.
EVALUATION METHODOLOGY
RAPID EVALUATION
RAPID EVALUATION METHODS
RAPID RESEARCH
Journal
Health and social care delivery research
ISSN: 2755-0060
Titre abrégé: Health Soc Care Deliv Res
Pays: England
ID NLM: 9918470788706676
Informations de publication
Date de publication:
Jul 2023
Jul 2023
Historique:
medline:
2
11
2023
pubmed:
5
10
2023
entrez:
5
10
2023
Statut:
ppublish
Résumé
This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (RSET: 16/138/17; BRACE: 16/138/31).
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1-47Références
Riley WT, Glasgow RE, Etheredge L, Abernethy AP. Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin Transl Med 2013;2(1):1–6. https://pubmed.ncbi.nlm.nih.gov/23663660/
McNall M, Foster-Fishman PG. Methods of rapid evaluation, assessment, and appraisal. Am J Eva 2007;28(2):151–168. https://doi.org/10.1177/1098214007300895
Kingdon JW. How do issues get on public policy agendas? In Wilson WJ, editor. Sociology and the Public Agenda. New York, NY: Sage; 1993. pp. 40–50.
Whitty CJ. What makes an academic paper useful for health policy? BMC Med 2015;13:301. https://doi.org/10.1186/s12916-015-0544-8
Vindrola-Padros C, Sidhu MS, Georghiou T, Sherlaw-Johnson C, Singh KE, Tomini SM, et al. The implementation of remote home monitoring models during the COVID-19 pandemic in England. EClinicalMedicine 2021;34:100799. https://doi.org/10.1016/j.eclinm.2021.100799
Lamont T, Barber N, de Pury J, Fulop N, Garfield-Birkbeck S, Lilford R, et al. New approaches to evaluating complex health and care systems. BMJ 2016;352. https://doi.org/10.1136/bmj.i154
Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, et al. A scoping review of rapid review methods. BMC Med 2015;13:224. https://doi.org/10.1186/s12916-015-0465-6
Garritty CM, Norris SL, Moher D. Developing WHO rapid advice guidelines in the setting of a public health emergency. J Clin Epidemiol 2017;82:47–60. https://doi.org/10.1016/j.jclinepi.2016.08.010
Global Evaluation Initiative (GEI)’s rapid evaluation programme. World Bank Independent Evaluation Group and the UNDP Independent Evaluation Office. URL: www.globalevaluationinitiative.org/ (accessed October 2022).
Better Evaluation platform’s toolkits on rapid evaluation. URL: www.betterevaluation.org/ (accessed October 2022).
Centre for Evaluation and Research Evidence in the Victorian Department of Health in Australia. URL: https://www.dffh.vic.gov.au/centre-evaluation-and-research-evidence (accessed October 2022).
Department of Planning, Monitoring and Evaluation in South Africa. URL: www.dpme.gov.za/keyfocusareas/evaluationsSite/Pages/default.aspx (accessed October 2022).
Office of Planning, Research, and Evaluation in the U.S. Department of Health and Human Services. URL: https://web.archive.org/web/20170303030959/https://www.acf.hhs.gov/opre (accessed October 2022).
Rapid Research Evaluation and Appraisal Lab (RREAL) URL: www.rapidresearchandevaluation.com/ (accessed October 2022).
Sheffield Evidence Synthesis Centre URL: https://hsdr.sites.sheffield.ac.uk/ (accessed October 2022).
Evidence Synthesis Team – Medical School – University of Exeter. URL: https://medicine.exeter.ac.uk/esmi/workstreams/evidencesynthesisteam/ (accessed October 2022).
Nunns H. Responding to the demand for quicker evaluation findings. Soc Policy J N Z 2009;34:89–99.
McNall MA, Welch VE, Ruh KL, Mildner CA, Soto T. The use of rapid-feedback evaluation methods to improve the retention rates of an HIV/AIDS healthcare intervention. Eval Program Plann 2004;27:287–94. https://doi.org/10.1016/j.evalprogplan.2004.04.003
Sidhu MS, Ford GA, Fulop NJ, Roberts CM. Learning networks in the pandemic: mobilising evidence for improvement. BMJ 2022;379:e070215. https://doi.org/10.1136/bmj-2022-070215
Vindrola-Padros C. Doing Rapid Qualitative Research. New York, NY: Sage; 2021.
Norman G, Mason T, Durnville J, Bower P, Wilson P, Cullum N. Rapid evaluations of innovations: a scoping review. 2021. Pre-print. https://doi.org/10.21203/rs.3.rs-1086327/v1
Beebe J. Rapid Qualitative Inquiry: A Field Guide to Team-Based Assessment. 2nd edn. Washington, DC: Rowman and Littlefield; 2014.
Johnson GA, Vindrola-Padros C. Rapid qualitative research methods during complex health emergencies: a systematic review of the literature. Soc Sci Med 2017;189:63–75. https://doi.org/10.1016/j.socscimed.2017.07.029
Vindrola-Padros C, Vindrola-Padros B. Quick and dirty? A systematic review of the use of rapid ethnographies in healthcare organisation and delivery. BMJ Quality and Safety 2017;27:321–30. https://qualitysafety.bmj.com/content/27/4/321
Vindrola-Padros C, Singh KE, Sidhu MS, Georghiou T, Sherlaw-Johnson C, Tomini SM, et al. Remote home monitoring (virtual wards) for confirmed or suspected COVID-19 patients: a rapid systematic review. Lancet EClinMed 2021;37:100965. https://doi.org/10.1016/j.eclinm.2021.100965
Vindrola-Padros C, Ledger J, Capelas Barbosa E, Fulop NJ. The implementation of improvement interventions for ‘low performing’ and ‘high performing’ organisations in health, education and local government: a phased literature review. Int J Health Policy Manag 2022;11:874–82. https://doi.org/10.34172/ijhpm.2020.197
Nuffield Trust. Naomi Fulop and Chris Sherlaw-Johnson. Special measures for quality: a Q&A on the impact of improvement interventions in NHS trusts. URL: www.nuffieldtrust.org.uk/news-item/special-measures-for-quality-a-q-a-on-the-impact-of-improvement-interventions-in-nhs-trusts (accessed October 2022).
BRACE Rapid Evaluation Centre. Children and Young People’s Mental Health Trailblazer programme. URL: https://www.birmingham.ac.uk/research/brace/projects/children-and-young-people's-mental-health-trailblazer-programme.aspx (accessed October 2022).
Vindrola-Padros C, Brage E, Johnson GA. Rapid, responsive, and relevant? A systematic review of rapid evaluations in health care. Am J Eval 2021;42:13–27. https://doi.org/10.1177/1098214019886914
Vindrola-Padros C. Rapid Ethnographies: A Practical Guide. Cambridge: University of Cambridge Press; 2020.
Walton H, Vindrola-Padros C, Crellin NE, Sidhu MS, Herlitz L, Litchfield I, et al. Patients’ experiences of, and engagement with, remote home monitoring services for COVID-19 patients: a rapid mixed-methods study. Health Expect 2022;25:2386–404. https://doi.org/10.1111/hex.13548
Cowan K, Fulop NJ, Harshfield A, Ng PL. Rapid prioritisation of topics for rapid evaluation: the case of innovations in adult social care and social work. Health Res Policy Sys 2021;19:34. https://doi.org/10.1186/s12961-021-00693-2
Walton H, Hirschfield A, Tomini S, Ng PL, Cowan K, Sussex J, et al. Innovations in Adult Social Care and Social Work Report. 2019. URL: www.birmingham.ac.uk/documents/college-social-sciences/social-policy/brace/innovations-in-adult-social-care-and-social-work-report.pdf (accessed May 2022).
Glasby J, Litchfield I, Parkinson S, Hocking L, Tanner D, et al. New and emerging technology for adult social care - the example of home sensors with artificial intelligence (AI) technology. Health Serv Deliv Res 2022. https://doi.org/10.3310/hsdr-tr-134314
NIHR RSET (Rapid Service Evaluation Team) project. Peer support initiatives for adult social care in prisons in England and Wales. URL: https://www.nuffieldtrust.org.uk/rset-rapid-evaluations-of-new-ways-of-providing-care/projects/peer-supported-social-care-in-prisons-0 (accessed October 2022).
James Lind Alliance (JLA) Symposium, 23 June 2015. Learning from JLA Evaluations – Shaping Future JLA Methods. Symposium Report – prepared by Sally Crowe, Crowe Associates, with the JLA team at NETSCC, JLA Advisers and speakers/contributors to the day. 2015. URL: www.jla.nihr.ac.uk/news-and-publications/downloads/report%20-%20June%202015%20JLA%20Symposium.pdf (accessed October 2022).
Tong A, Synnot A, Crowe S, Hill S, Matus A, Scholes-Robertson N, et al. Reporting guideline for priority setting of health research (REPRISE). BMC Med Res Methodol 2019;19 (243). https://doi.org/10.1186/s12874-019-0889-3
Chepo M, Iqbal S, Hebert M, Vindrola-Padros C. To scope or not to scope? The benefits and challenges of integrating scoping studies in rapid qualitative research and evaluation. 2022. Preprint. https://doi.org/10.31219/osf.io/2vs9n
Vindrola-Padros C. Can we re-Imagine research so it is timely, relevant and responsive? Comment on ‘Experience of health leadership in partnering with university-based researchers in Canada: a call to “re-imagine” research’. Int J Health Policy Manag 2021;3:172. https://doi.org/10.34172/ijhpm.2020.43
Lam S, Skinner K. The use of evaluability assessments in improving future evaluations: a scoping review of 10 years of literature (2008–2018). Am J Eval 2021;42:523–40. https://doi.org/10.1177/1098214020936769
Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Quality & Safety 2015;24:228–38. http://doi.org/10.1136/bmjqs-2014-003627
Royal College of Obstetricians and Gynaecologists. Better for Women: Improving the Health and Wellbeing of Girls and Women. London: RCOG; 2019. URL: https://www.rcog.org.uk/better-for-women (accessed July 2023).
Singh K, Taylor B. Women’s health hubs – study protocol. 2022. URL: https://fundingawards.nihr.ac.uk/award/NIHR135589 (accessed May 2022).
Bowen S, Botting I, Graham ID, MacLeod M, de Moissac D, Harlos K. Experience of health leadership in partnering with university-based researchers in Canada: a call to ‘re-imagine’ research. Int J Health Policy Manag 2019;8:684–99. https://doi.org/10.15171/ijhpm.2019.66
Ranjan S, McKee M, Roberts M, Mantell K. Rapid evaluation of health and care services – planning a sustainable solution for the post-COVID reset. 2021. URL: https://www.ahsnnetwork.com/wp-content/uploads/2021/02/Rapid_Evaluation_of_Health_and_Care_Services_FINAL.pdf (accessed October 2022).
Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: a systematic review. BMC Health Serv Res 2014;14:89. https://doi.org/10.1186/1472-6963-14-89
Ocloo J, Garfield S, Franklin BD, Dawson S. Exploring the theory, barriers and enablers for patient and public involvement across health, social care and patient safety: a systematic review of reviews. Health Res Policy Sys 2021;19:8. https://doi.org/10.1186/s12961-020-00644-3
Saunders CL, Gkousis E. Impact of telephone triage on access to primary care for people living with multiple long-term health conditions: rapid evaluation. Health Soc Care Deliv Res 2022;10(18). https://doi.org/10.3310/ucce5549
Jamal Z, Perkins A, Allen C, Evans R, Sturgess J, Snowdon C, et al. Research Advisory Group. Patient and public involvement prior to trial initiation: lessons learnt for rapid partnership in the COVID-19 era. Res Involv Engagem 2021;7:13. https://doi.org/10.1186/s40900-021-00250-9
INVOLVE. Guidance on Co-producing a Research Project. 2018. URL: www.invo.org.uk/wp-content/uploads/2019/04/Copro_Guidance_Feb19.pdf (accessed May 2022).
Buurtzorg International. The Buurtzorg model. URL: www.buurtzorg.com/ (accessed October 2022).
Kings Fund. A Review of the West Suffolk Buurtzorg Test-and-Learn in 2017–18. URL: https://www.kingsfund.org.uk/publications/review-west-suffolk-buurtzorg-test-and-learn-2017-18 (accessed October 2022).
Suffolk Health and Wellbeing Board. A committee of Suffolk County Council. Neighbourhood Nursing and Care Team – Buurtzorg Inspired Test and Learn. URL: https://www.kingsfund.org.uk/publications/review-west-suffolk-buurtzorg-test-and-learn-2017-18 (accessed October 2022).
Appleby J, Georghiou T, Ledger J, Rolewicz L, Sherlaw-Johnson C, Tomini SM, et al. Youth violence intervention programme for vulnerable young people attending emergency departments in London: a rapid evaluation. Health Soc Care Deliv Res 2023;11. In press.
NIHR RSET (Rapid Service Evaluation Team) project. Special measures for quality improvement and challenged providers. https://www.nuffieldtrust.org.uk/rset-rapid-evaluations-of-new-ways-of-providing-care/projects/completed-evaluations/special-measures-for-quality-improvement-and-challenged-providers-0 (accessed October 2022).
NIHR RSET (Rapid Service Evaluation Team) project. Reduction in Youth Violence Intervention Programme. URL: https://www.nuffieldtrust.org.uk/rset-rapid-evaluations-of-new-ways-of-providing-care/projects/completed-evaluations/evaluating-a-youth-violence-intervention-programme-0 (accessed October 2022).
BRACE Rapid Evaluation Centre. Acute hospitals managing general practice services. URL: www.birmingham.ac.uk/research/brace/projects/acute-hospitals-managing-general-practice-services.aspx (accessed October 2022).
Fulop NJ, Walton H, Crellin N, Georghiou T, Herlitz L, Litchfield I, et al. A rapid mixed-methods evaluation of remote home monitoring models during the COVID-19 pandemic in England. Health Soc Care Deliv Res 2023. In press.
Wolters A. Rethinking Evaluation: The Rigour of Rapidity. The Health Foundation (blog) 2019. URL: www.health.org.uk/news-and-comment/blogs/rethinking-evaluation-the-rigour-of-rapidity (accessed May 2022).
Gold M, Helms D, Guterman S. Identifying, monitoring, and assessing promising innovations: using evaluation to support rapid-cycle change. Commonwealth Fund Publication 2011;12:1512.
Bamberger M, Rugh J, Church M, Fort L. Shoestring evaluation: designing impact evaluations under budget, time and data constraints. Am J Eval 2004;25(1):5–37. https://doi.org/10.1016/j.ameval.2003.11.001
Holdsworth L, Safaeinili N, Winget M, Lorenz KA, Lough M, Asch S, Malcolm E. Adapting rapid assessment procedures for implementation research using a team-based approach to analysis: a case example of patient quality and safety interventions in the ICU. Implementation Sci 2020;15:12. https://doi.org/10.1186/s13012-020-0972-5
Fulop NJ, Barbosa E, Hill M, Ledger J. Rapid Evaluation of the Special Measures for Quality and Challenged Provider Regimes: A Mixed-Methods Study. Health Soc Care Deliv Res 2023. In press.
NHS. GP Patient Survey. URL: https://www.gp-patient.co.uk/ (accessed October 2022).
Understanding Society. The UK Household Longitudinal Study. URL: www.understandingsociety.ac.uk (accessed October 2022).
Sherlaw-Johnson C, Georghiou T, Morris S, Crellin NE, Litchfield I, Massou E, et al. The impact of remote home monitoring of people with COVID-19 using pulse oximetry: a national population and observational study. eClinicalMedicine 2022;45:101318. https://doi.org/10.1016/j.eclinm.2022.101318
Cody S, Asher A. Smarter, Better, Faster: The Potential for Predictive Analytics and Rapid-Cycle Evaluation to Improve Program Development and Outcomes. 2006. URL: www.hamiltonproject.org/papers/predictive_analytics_rapid-cycle_evaluation_improve_program_outcomes (accessed May 2022).
Nunns H. Evaluation in dynamic times: skateboard, pushbike, or quad bike? Evaluation Matters – He Take Tō Te Aromatawai 2020;6:1–9. https://doi.org/10.18296/em.0053
Panovska-Griffiths J, Kerr CC, Stuart RM, Mistry D, Klein DJ, Viner RM, et al. Determining the optimal strategy for reopening schools, the impact of test and trace interventions, and the risk of occurrence of a second COVID-19 epidemic wave in the UK: a modelling study. Lancet Child Adolesc Health 2020;4:817–27. https://doi.org/10.1016/s2352-4642(20)30250-9
Bell LC, Norris-Grey C, Luintel A, Bidwell G, Lanham D, Marks M, et al. Implementation and evaluation of a COVID-19 rapid follow-up service for patients discharged from the emergency department. Clin Med 2021;21:e57–e62. https://doi.org/10.7861/clinmed.2020-0816
Sherlaw-Johnson C, Philips Z. An evaluation of liquid-based cytology and human papillomavirus testing within the UK cervical cancer screening programme. Br J Cancer 2004;91:84–91. https://doi.org/10.1038/sj.bjc.6601884
Gross D. Fundamentals of Queueing Theory. Oxford: John Wiley & Sons; 2008.
Wood RM. Modelling the impact of COVID-19 on elective waiting times. J Simul 2022;16:101–9. https://doi.org/10.1080/17477778.2020.1764876
Kohli M, Ferko N, Martin A, Franco EL, Jenkins D, Gallivan S, et al. Estimating the long-term impact of a prophylactic human papillomavirus (HPV) 16/18 vaccine on the burden of cervical cancer in the UK. Br J Cancer 2007;96:143–50. https://doi.org/10.1038/sj.bjc.6603501
Sherlaw-Johnson C, Bardsley M. Monitoring Change in Health Care Through Statistical Process Control. Research Report. London: Nuffield Trust; 2016. URL: https://www.nuffieldtrust.org.uk/research/monitoring-change-in-health-care-through-statistical-process-control-methods (accessed July 2023).
Silva IR, Lingling L, Kulldorff M. Exact conditional maximized sequential probability ratio test adjusted for covariates. Seq Anal 2019;38:115–33. https://doi.org/10.1080/07474946.2019.1574446
Spiegelhalter D, Sherlaw-Johnson C, Bardsley M, Blunt I, Wood C, Grigg O. Statistical methods for healthcare regulation: rating, screening and surveillance. J Roy Stat Soc 2012;175:1–47. https://doi.org/10.1111/j.1467-985X.2011.01010.x
Pagel C, Utley M, Crowe S, Witter T, Anderson D, Samson R, et al. Real time monitoring of risk-adjusted paediatric cardiac surgery outcomes using variable life-adjusted display: implementation in three UK centres. Heart 2013;99:1445–50. https://doi.org/10.1136/heartjnl-2013-303671
Duckett SJ, Coory M, Sketcher-Baker K. Identifying variations in quality of care in Queensland hospitals. Med J Aust 2007;187:571–5. https://doi.org/10.5694/j.1326-5377.2007.tb01419.x
NHS England and NHS Improvement. Online library of Quality, Service Improvement and Redesign tools: Statistical process control. 2022. www.england.nhs.uk/wp-content/uploads/2022/02/qsir-statistical-process-control.pdf (accessed September 2022).
Lu CY, Penfold RB, Toh S, Sturtevant JL, Madden JM, Simon G, et al. Near real-time surveillance for consequences of health policies using sequential analysis. Med Care 2018;56:365–72. https://doi.org/10.1097/mlr.0000000000000893
Vindrola-Padros C, Johnson GA. Rapid techniques in qualitative research: a critical review of the literature. Qual Health Res 2020;30:1596–604. https://doi.org/10.1177/1049732320921835
Tiersma K, Reichman M, Popok PJ, Nelson Z, Barry M, Elwy AR, Vranceanu AM. The strategies for quantitative and qualitative remote data collection: lessons from the COVID-19 pandemic. JMIR Form Res 2022;6:e30055. https://doi.org/10.2196/30055
Hensen B, Mackworth-Young CRS, Simwinga M, Abdelmagid N, Banda J, Mavodza C, Weiss HA. Remote data collection for public health research in a COVID-19 era: ethical implications, challenges and opportunities. Health Policy Plan 2021;36:360–68. https://doi.org/10.1093/heapol/czaa158
Islam S, Joseph O, Chaudry A, Forde D, Keane A, Wilson C, et al. ‘We are not hard to reach, but we may find it hard to trust’ … . Involving and engaging ‘seldom listened to’ community voices in clinical translational health research: a social innovation approach. Res Involv Engagem 2021;7:46 https://doi.org/10.1186/s40900-021-00292-z
Goedhart NS, Pittens CA, Tončinić S, Zuiderent-Jerak T, Dedding C, Broerse JE. Engaging citizens living in vulnerable circumstances in research: a narrative review using a systematic search. Res Involv Engagem 2021;7:59. https://doi.org/10.1186/s40900-021-00306-w
Skillman M, Cross-Barnet C, Friedman Singer R, Rotondo C, Ruiz S, Moiduddin A. A framework for rigorous qualitative research as a component of mixed method rapid-cycle evaluation. Qual Health Res 2019;29:279–89. https://doi.org/10.1177/1049732318795675
Vindrola-Padros C, Chisnall G, Cooper S, Dowrick A, Djellouli N, Mulcahy Symmons S, et al. Carrying out rapid qualitative research during a pandemic: emerging lessons from COVID-19. Qual Health Res 2020;30:2192–204. https://doi.org/10.1177/1049732320951526
Hammersley M. Troubles with triangulation. In Bergman MM, editor. Advances in Mixed Methods Research. London: Sage; 2008. pp. 22–36.
Denzin NK, Lincoln YS, editors. Handbook of Qualitative Research. 2nd edn. Thousand Oaks, CA: Sage; 2005.
Seale C, Gobo G, Gubrium JF, Silverman D, editors. Qualitative Research Practice. London: Sage; 2004.
Seale C. The Quality of Qualitative Research. London: Sage; 1999.
Tracy SJ. Qualitative quality: eight ‘big-tent’ criteria for excellent qualitative research. Qualitative Inquiry 2010;16:837–51. https://doi.org/10.1177/1077800410383121
Anderson R, Booth A, Eastwood A, Rodgers M, Shaw L, Thompson-Coon J, et al. Synthesis for health services and policy: case studies in the scoping of reviews. Health Serv Deliv Res 2021;9(15). https://doi.org/10.3310/hsdr09150
Smith JA, Parkinson S, Harshfield A, Sidhu M. Early evidence of the development of primary care networks in the NHS in England: a rapid evaluation study. Health Soc Care Deliv Res 2022;10(27). https://doi.org/10.3310/GBUO3259
Bikker A, Atherton H, Brant H, Porqueddu T, Campbell JL, Gibson A, et al. Conducting a team-based multi-sited focused ethnography in primary care. BMC Med Res Methodol 2017;17:139. https://doi.org/10.1186/s12874-017-0422-5
Brewster L, Aveling EL, Martin G, Tarrant C, Dixon-Woods M; Safer clinical systems phase 2 core group collaboration & writing committee. What to expect when you’re evaluating healthcare improvement: a concordat approach to managing collaboration and uncomfortable realities. BMJ Qual Saf 2015;24:318–24. https://qualitysafety.bmj.com/content/24/5/318
Dixon-Woods M. How to improve healthcare improvement – an essay by Mary Dixon-Woods. BMJ 2019;367:l5514. https://doi.org/10.1136/bmj.l5514
Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Sys 2019;17:33. https://doi.org/10.1186/s12961-019-0432-3
Rankl F, Johnson GA, Vindrola-Padros C. Examining what we know in relation to how we know it: a team-based reflexivity model for rapid qualitative health research. Qual Health Res 2021;31:1358–70. https://doi.org/10.1177/1049732321998062
Ramsay AIG, Ledger J, Tomini SM, Hall C, Hargroves D, Hunter P, et al. Prehospital video triage of potential stroke patients in North Central London and East Kent: rapid mixed-methods service evaluation. Health Soc Care Deliv Res 2022;10(26). https://doi.org/10.3310/IQZN1725
Nuffield Trust. Pre-hospital triage for potential stroke patients: a Q&A with Angus Ramsay. URL: https://www.nuffieldtrust.org.uk/news-item/pre-hospital-triage-for-potential-stroke-patients-a-q-a-with-angus-ramsay (accessed October 2022).
UCL Institute of Epidemiology and Healthcare. PHOTONIC: Prehospital triage for suspected stroke patients. 2022. URL: www.ucl.ac.uk/epidemiology-health-care/research/applied-health-research/research/health-care-organisation-and-management-group/photonic (accessed October 2022).
Pettigrew A, Ferlie E, McKee L. Shaping strategic change – the case of the NHS in the 1980s. Public Money Manage 1992;12:3. https://doi.org/10.1080/09540969209387719
Marshall MN. Bridging the ivory towers and the swampy lowlands; increasing the impact of health services research on quality improvement. Int J Qual Health Care 2014;26:1–5. https://doi.org/10.1093/intqhc/mzt076
Science, Research and Evidence Directorate. Translating Research for Policy Makers Toolkit. London: Department of Health and Social Care; 2020.
Walton H, Crellin NE, Sidhu MS, Sherlaw-Johnson C, Herlitz L, Litchfield I, et al. Undertaking rapid evaluations during the COVID-19 pandemic: lessons from evaluating COVID-19 remote home monitoring services. Front Sociol 2023;8. https://doi.org/10.3389/fsoc.2023.982946).
Health Service Journal. NHS England asks ICS leader to review ‘next steps’ for primary care. Health Serv J 2021. URL: www.hsj.co.uk/primary-care/nhs-england-asks-ics-leader-to-review-next-steps-for-primary-care/7031298.article (accessed May 2022).
Phillips S, Ede R, Landau D. At Your Service: A Proposal to Reform General Practice and Enable Digital Healthcare at Scale. London: Policy Exchange; 2022.
Lamont T. Making Research Matter. Steps to Impact for Health and Care Researchers. Bristol: Policy Press; 2021.
Shrank W. The Center for Medicare and Medicaid Innovation’s blueprint for rapid-cycle evaluation of new care and payment models. Health Affairs 2013;32:807–12. https://doi.org/10.1377/hlthaff.2013.0216
Gawaya M, Terrill D, Williams E. Using rapid evaluation methods to assess service delivery changes: Lessons learned for evaluation practice during the COVID-19 pandemic. Eval J Australas 2022;22:30–48. https://doi.org/10.1177/1035719X211057630