Evaluating complex transformation.
Emergency response
Evaluation
Opioid crisis
System transformation
Journal
Journal of health organization and management
ISSN: 1758-7247
Titre abrégé: J Health Organ Manag
Pays: England
ID NLM: 101179473
Informations de publication
Date de publication:
06 Nov 2019
06 Nov 2019
Historique:
entrez:
5
5
2020
pubmed:
5
5
2020
medline:
22
9
2020
Statut:
ppublish
Résumé
The purpose of this paper is to present a detailed case study of the evaluation strategies of a complex, multi-faceted response to a public health emergency: drug-related overdose deaths. It sets out the challenges of evaluating such a complex response and how they were overcome. It provides a pragmatic example of the rationale and issues faced to address the what, the why and particularly the how of the evaluation. The case study overviews British Columbia's Provincial Response to the Overdose Public Health Emergency, and the aims and scope of its evaluation. It then outlines the conceptual approach taken to the evaluation, setting out key methodological challenges in evaluating large-scale, multi-level, multisectoral change. The evaluation is developmental and summative, utilization focused and system informed. Defining the scope of the evaluation required a strong level of engagement with government leads, grantees and other evaluation stakeholders. Mixed method evaluation will be used to capture the complex pattern of relationships that have informed the overdose response. Working alongside people with drug use experience to both plan and inform the evaluation is critical to its success. This case study builds on a growing literature on evaluating large-scale and complex service transformation, providing a practical example of this.
Identifiants
pubmed: 32364344
doi: 10.1108/JHOM-05-2019-0139
doi:
Types de publication
Evaluation Study
Journal Article
Langues
eng
Pagination
313-324Informations de copyright
© Emerald Publishing Limited.
Références
BC Centre for Substance Use (2018), “A guidelines for the clinical management of opioid use disorder”, available at: www.bccsu.ca/wp-content/uploads/2017/06/BC-OUD-Guidelines_June2017.pdf (accessed October 25, 2019).
Becu, A. and Allan, L. (2017), “Peer payment standards for short-term engagement”, BC Centre for Disease Control, Vancouver.
Best, A., Greenhalgh, T., Saul, J., Lewis, S., Carroll, S. and Bitz, J. (2012), “Large system transformation in health care: a realist review and evaluation of its usefulness in a policy context”, Milbank Quarterly, Vol. 90 No. 3, pp. 421-456, available at: www.milbank.org/publications/the-milbank-quarterly/featured-articles/article/3893/large-system-transformation-in-health-care-a-realist-review (accessed May 8, 2019).
Checkland, P.B. and Poulter, J. (2016), Learning for Action: A Short Definitive Account of Soft Systems Methodology and Its Use for Practitioners, Teachers, and Students, John Wiley, Chichester.
First Nations Health Authority (2010), Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans - Chapter 9: Research Involving the First Nations, Inuit and Métis Peoples of Canada, 2nd ed., Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada, December.
First Nations Health Authority (2017), “Overdose dataand first nations in BC: preliminary findings”, in First Nations Health Authority (Ed.), Coast Salish Territory, First Nations Health Authority, West Vancouver, pp. 1-16, available at: www.fnha.ca/newsContent/Documents/FNHA_OverdoseDataAndFirstNationsInBC_PreliminaryFindings_FinalWeb.pdf (accessed May 8, 2019).
Friedman, S.R., Reynolds, J., Quan, M.A., Call, S., Crusto, C.A. and Kaufman, J.S. (2007), “Measuring changes in interagency collaboration: an examination of the Bridgeport safe start initiative”, Evaluation and Program Planning, Vol. 30 No. 3, pp. 294-306.
Halfon, N., Long, P., Chang, D.I., Hester, J., Inkelas, M. and Rodgers, A. (2014), “Applying a 3.0 transformation framework to guide large-scale health system reform”, Health Affairs, Vol. 33 No. 11, pp. 2-3, available at: https://doi.org/10.1377/hlthaff.2014.0485
Hargreaves, M. (2010), “Evaluating system change: a planning guide”, available at: www.tamarackcommunity.ca/hubfs/Resources/Evaluating%20Systems%20Change%20a%20Planning%20Guide.pdf (accessed April 17, 2019).
Holmes, B., Best, A., Davies, H., Hunter, D., Kelly, M., Marshall, M. and Rycroft-Malone, J. (2017), “Mobilising knowledge in complex health systems: a call to action”, Evidence and Policy, Vol. 13 No. 3, pp. 539-560, available at: https://doi.org/10.1332/174426416X14712553750311
Hummelbrunner, R. (2000), “A systems approach to evaluation: applications of systems theory and systems thinking in evaluations”, paper prepared for the 4th EES Conference, Lausanne, available at: https://evaluationcanada.ca/distribution/20001012_hummelbrunner_richard.pdf (accessed May 8, 2019).
Patton, M.Q. (2008), The Essentials of Utilisation Focused Evaluation, 4th ed., Sage Publications, Thousand Oaks, CA.
Patton, M.Q. (2010a), Developmental Evaluation: Enhancing Social Innovation and Use in Complex Systems, Guilford Press, New York, NY.
Patton, M.Q. (2010b), “Developmental evaluation: applying complexity concepts to enhance innovation and use”, 1st ed., Guilford Publications, Inc.
Provan, K.G. and Kenis, P. (2008), “Modes of network governance: structure, management, and effectiveness”, Journal of Public Administration Research and Theory, Vol. 18 No. 2, pp. 229-252.
Provan, K.G. and Lemaire, R.H. (2012), “Core concepts and key ideas for understanding public sector organizational networks: using research to inform scholarship and practice”, Public Administration Review, Vol. 72 No. 5, pp. 638-648.
Provincial Health Services Authority (n.d.), “San’yas indigenous cultural safety training”, available at: www.sanyas.ca/home (accessed May 8, 2019).
Sterman, J.D. (2006), “Learning from evidence in a complex world”, American Journal of Public Health, Vol. 96 No. 3, pp. 505-514.
WHO (2002), “Towards better stewardship: concepts and critical issues”, World Health Organisation, Geneva, available at: www.who.int/healthinfo/paper48.pdf (accessed May 1, 2019).
WHO and United Nations Office on Drugs and Crime (2013), “Opioid overdose: preventing and reducing opioid overdose mortality”, World Health Organisation and United Nations Office on Drugs and Crime, Vienna, available at: www.who.int/substance_abuse/publications/opioid_overdose.pdf?ua=1 (accessed May 1, 2019).