Framework for identification and measurement of spillover effects in policy implementation: intended non-intended targeted non-targeted spillovers (INTENTS).

Evaluation Health policy Healthcare economics and organisations Programme evaluation Spillover effects Unintended effects

Journal

Implementation science communications
ISSN: 2662-2211
Titre abrégé: Implement Sci Commun
Pays: England
ID NLM: 101764360

Informations de publication

Date de publication:
14 Mar 2022
Historique:
received: 22 10 2021
accepted: 01 03 2022
entrez: 15 3 2022
pubmed: 16 3 2022
medline: 16 3 2022
Statut: epublish

Résumé

There is increasing awareness among researchers and policymakers of the potential for healthcare interventions to have consequences beyond those initially intended. These unintended consequences or "spillover effects" result from the complex features of healthcare organisation and delivery and can either increase or decrease overall effectiveness. Their potential influence has important consequences for the design and evaluation of implementation strategies and for decision-making. However, consideration of spillovers remains partial and unsystematic. We develop a comprehensive framework for the identification and measurement of spillover effects resulting from changes to the way in which healthcare services are organised and delivered. We conducted a scoping review to map the existing literature on spillover effects in health and healthcare interventions and used the findings of this review to develop a comprehensive framework to identify and measure spillover effects. The scoping review identified a wide range of different spillover effects, either experienced by agents not intentionally targeted by an intervention or representing unintended effects for targeted agents. Our scoping review revealed that spillover effects tend to be discussed in papers only when they are found to be statistically significant or might account for unexpected findings, rather than as a pre-specified feature of evaluation studies. This hinders the ability to assess all potential implications of a given policy or intervention. We propose a taxonomy of spillover effects, classified based on the outcome and the unit experiencing the effect: within-unit, between-unit, and diagonal spillover effects. We then present the INTENTS framework: Intended Non-intended TargEted Non-Targeted Spillovers. The INTENTS framework considers the units and outcomes which may be affected by an intervention and the mechanisms by which spillover effects are generated. The INTENTS framework provides a structured guide for researchers and policymakers when considering the potential effects that implementation strategies may generate, and the steps to take when designing and evaluating such interventions. Application of the INTENTS framework will enable spillover effects to be addressed appropriately in future evaluations and decision-making, ensuring that the full range of costs and benefits of interventions are correctly identified.

Sections du résumé

BACKGROUND BACKGROUND
There is increasing awareness among researchers and policymakers of the potential for healthcare interventions to have consequences beyond those initially intended. These unintended consequences or "spillover effects" result from the complex features of healthcare organisation and delivery and can either increase or decrease overall effectiveness. Their potential influence has important consequences for the design and evaluation of implementation strategies and for decision-making. However, consideration of spillovers remains partial and unsystematic. We develop a comprehensive framework for the identification and measurement of spillover effects resulting from changes to the way in which healthcare services are organised and delivered.
METHODS METHODS
We conducted a scoping review to map the existing literature on spillover effects in health and healthcare interventions and used the findings of this review to develop a comprehensive framework to identify and measure spillover effects.
RESULTS RESULTS
The scoping review identified a wide range of different spillover effects, either experienced by agents not intentionally targeted by an intervention or representing unintended effects for targeted agents. Our scoping review revealed that spillover effects tend to be discussed in papers only when they are found to be statistically significant or might account for unexpected findings, rather than as a pre-specified feature of evaluation studies. This hinders the ability to assess all potential implications of a given policy or intervention. We propose a taxonomy of spillover effects, classified based on the outcome and the unit experiencing the effect: within-unit, between-unit, and diagonal spillover effects. We then present the INTENTS framework: Intended Non-intended TargEted Non-Targeted Spillovers. The INTENTS framework considers the units and outcomes which may be affected by an intervention and the mechanisms by which spillover effects are generated.
CONCLUSIONS CONCLUSIONS
The INTENTS framework provides a structured guide for researchers and policymakers when considering the potential effects that implementation strategies may generate, and the steps to take when designing and evaluating such interventions. Application of the INTENTS framework will enable spillover effects to be addressed appropriately in future evaluations and decision-making, ensuring that the full range of costs and benefits of interventions are correctly identified.

Identifiants

pubmed: 35287757
doi: 10.1186/s43058-022-00280-8
pii: 10.1186/s43058-022-00280-8
pmc: PMC8919154
doi:

Types de publication

Journal Article

Langues

eng

Pagination

30

Subventions

Organisme : Medical Research Council
ID : MR/P026834/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/R013314/1
Pays : United Kingdom

Informations de copyright

© 2022. The Author(s).

Références

Implement Sci. 2020 Jun 8;15(1):42
pubmed: 32513292
Milbank Q. 2018 Mar;96(1):57-109
pubmed: 29504199
N Engl J Med. 2018 Sep 06;379(10):948-957
pubmed: 30184445
Cochrane Database Syst Rev. 2011 Jul 06;(7):CD009255
pubmed: 21735443
Front Psychol. 2019 Apr 05;10:342
pubmed: 31024368
BMJ. 2016 Aug 04;354:i4060
pubmed: 27492602
Soc Sci Med. 2017 Jan;173:9-17
pubmed: 27914316
J Cancer Educ. 2014 Jun;29(2):258-65
pubmed: 24254248
Int J Epidemiol. 2018 Feb 1;47(1):332-347
pubmed: 29106568
Br J Gen Pract. 2017 Nov;67(664):e775-e784
pubmed: 28947621
J Occup Rehabil. 2019 Mar;29(1):11-24
pubmed: 29948471
Health Technol Assess. 2021 Sep;25(57):1-132
pubmed: 34590577
BMC Int Health Hum Rights. 2014 Apr 01;14:10
pubmed: 24690131
BMJ. 2007 Jun 30;334(7608):1357
pubmed: 17580318
Med Care. 2018 Apr;56(4):321-328
pubmed: 29462076
BMJ. 2011 Jun 28;342:d3590
pubmed: 21712336
Ann Intern Med. 2017 Mar 7;166(5):341-353
pubmed: 28114600
Prev Chronic Dis. 2012;9:E36
pubmed: 22239751
Ann Fam Med. 2012 Sep-Oct;10(5):461-8
pubmed: 22966110
Implement Sci. 2013 Mar 15;8:32
pubmed: 23497520
J Health Econ. 2018 Nov;62:105-120
pubmed: 30339989
J Health Econ. 2017 Sep;55:45-60
pubmed: 28655489
Br J Gen Pract. 2019 Mar;69(680):e154-e163
pubmed: 30803980
Health Econ. 2010 Jan;19(1):1-13
pubmed: 19206084
Health Serv Res. 2018 Jun;53(3):1478-1497
pubmed: 28480598
Implement Sci. 2019 Aug 14;14(1):80
pubmed: 31412887
BMC Med Res Methodol. 2018 Nov 19;18(1):143
pubmed: 30453902
Health Econ. 2011 Feb;20(2):225-38
pubmed: 20104571
Implement Sci. 2020 Jan 9;15(1):2
pubmed: 31915032
J Interprof Care. 2011 May;25(3):167-74
pubmed: 21182439
Ann Intern Med. 2018 Oct 2;169(7):467-473
pubmed: 30178033
J Clin Epidemiol. 2013 Nov;66(11):1209-14
pubmed: 23953085
J Health Econ. 2013 Dec;32(6):1356-67
pubmed: 24308884
Implement Sci. 2010 Sep 20;5:69
pubmed: 20854677
Am J Trop Med Hyg. 2019 Dec;101(6):1434-1441
pubmed: 31595867
Int J Epidemiol. 2017 Aug 1;46(4):1251-1276
pubmed: 28449030
Implement Sci. 2020 Apr 16;15(1):21
pubmed: 32299461
J Sch Health. 2014 Oct;84(10):617-24
pubmed: 25154525
J Med Screen. 2018 Sep;25(3):134-140
pubmed: 28782403
BMJ Open. 2011 Jun 02;1(1):e000023
pubmed: 22021730
BMC Public Health. 2008 Sep 22;8:326
pubmed: 18808709
Health Serv Res. 2015 Aug;50(4):1109-24
pubmed: 25483853
Ann Surg. 2018 Apr;267(4):599-605
pubmed: 28657950
Implement Sci. 2014 Dec 18;9:168
pubmed: 25518730
Implement Sci. 2019 Dec 5;14(1):102
pubmed: 31806037
Int J Equity Health. 2018 Nov 22;17(1):174
pubmed: 30466443
BMC Fam Pract. 2020 Jul 13;21(1):142
pubmed: 32660427
Health Serv Res. 2015 Dec;50 Suppl 2:2090-115
pubmed: 26573887
Eval Rev. 2000 Aug;24(4):407-31
pubmed: 11009866
Proc Natl Acad Sci U S A. 2020 Aug 11;117(32):18939-18947
pubmed: 32719129
BMC Health Serv Res. 2017 Dec 19;17(1):837
pubmed: 29258524

Auteurs

Igor Francetic (I)

Health Organization, Policy and Economics (HOPE) Research Group, Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK. igor.francetic@manchester.ac.uk.

Rachel Meacock (R)

Health Organization, Policy and Economics (HOPE) Research Group, Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK.

Jack Elliott (J)

Health Organization, Policy and Economics (HOPE) Research Group, Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK.

Søren R Kristensen (SR)

Danish Centre for Health Economics, University of Southern Denmark, Odense, Denmark.
Centre for Health Policy, Institute of Global Health Innovation, Imperial College London, London, UK.

Phillip Britteon (P)

Health Organization, Policy and Economics (HOPE) Research Group, Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK.

David G Lugo-Palacios (DG)

Centre for Health Policy, Institute of Global Health Innovation, Imperial College London, London, UK.
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK.

Paul Wilson (P)

Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK.

Matt Sutton (M)

Health Organization, Policy and Economics (HOPE) Research Group, Centre for Primary Care and Health Services Research, School of Health Sciences, University of Manchester, Manchester, UK.
Melbourne Institute: Applied Economic and Social Research, University of Melbourne, Melbourne, Australia.

Classifications MeSH