"We cobble together a storyline of system performance using a diversity of things": a qualitative study of perspectives on public health performance measurement in Canada.

Health system renewal; performance measurement system Indicators Public health Public health systems Qualitative analysis

Journal

Archives of public health = Archives belges de sante publique
ISSN: 0778-7367
Titre abrégé: Arch Public Health
Pays: England
ID NLM: 9208826

Informations de publication

Date de publication:
29 Jul 2022
Historique:
received: 07 04 2022
accepted: 07 07 2022
entrez: 29 7 2022
pubmed: 30 7 2022
medline: 30 7 2022
Statut: epublish

Résumé

There have been longstanding calls for public health systems transformations in many countries, including Canada. Core to these calls has been strengthening performance measurement. While advancements have been made in performance measurement for certain sectors of the health care system (primarily focused on acute and primary health care), effective use of indicators for measuring public health systems performance are lacking. This study describes the current state, anticipated challenges, and future directions in the development and implementation of a public health performance measurement system for Canada. We conducted a qualitative study using semi-structured interviews with public health leaders (n = 9) between July and August 2021. Public health leaders included researchers, government staff, and former medical officers of health who were purposively selected due to their expertise and experience with performance measurement with relevance to public health systems in Canada. Thematic analysis included both a deductive approach for themes consistent with the conceptual framework and an inductive approach to allow new themes to emerge from the data. Conceptual, methodological, contextual, and infrastructure challenges were highlighted by participants in designing a performance measurement system for public health. Specifically, six major themes evolved that encompass 1) the mission and purpose of public health systems, including challenges inherent in measuring the functions and services of public health; 2) the macro context, including the impacts of chronic underinvestment and one-time funding injections on the ability to sustain a measurement system; 3) the organizational structure/governance of public health systems including multiple forms across Canada and underdevelopment of information technology systems; 4) accountability approaches to performance measurement and management; and 5) timing and unobservability in public health indicators. These challenges require dedicated investment, strong leadership, and political will from the federal and provincial/territorial governments. Unprecedented attention on public health due to the coronavirus disease 2019 pandemic has highlighted opportunities for system improvements, such as addressing the lack of a performance measurement system. This study provides actionable knowledge on conceptual, methodological, contextual, and infrastructure challenges needed to design and build a pan-Canadian performance measurement system for public health.

Sections du résumé

BACKGROUND BACKGROUND
There have been longstanding calls for public health systems transformations in many countries, including Canada. Core to these calls has been strengthening performance measurement. While advancements have been made in performance measurement for certain sectors of the health care system (primarily focused on acute and primary health care), effective use of indicators for measuring public health systems performance are lacking. This study describes the current state, anticipated challenges, and future directions in the development and implementation of a public health performance measurement system for Canada.
METHODS METHODS
We conducted a qualitative study using semi-structured interviews with public health leaders (n = 9) between July and August 2021. Public health leaders included researchers, government staff, and former medical officers of health who were purposively selected due to their expertise and experience with performance measurement with relevance to public health systems in Canada. Thematic analysis included both a deductive approach for themes consistent with the conceptual framework and an inductive approach to allow new themes to emerge from the data.
RESULTS RESULTS
Conceptual, methodological, contextual, and infrastructure challenges were highlighted by participants in designing a performance measurement system for public health. Specifically, six major themes evolved that encompass 1) the mission and purpose of public health systems, including challenges inherent in measuring the functions and services of public health; 2) the macro context, including the impacts of chronic underinvestment and one-time funding injections on the ability to sustain a measurement system; 3) the organizational structure/governance of public health systems including multiple forms across Canada and underdevelopment of information technology systems; 4) accountability approaches to performance measurement and management; and 5) timing and unobservability in public health indicators. These challenges require dedicated investment, strong leadership, and political will from the federal and provincial/territorial governments.
CONCLUSION CONCLUSIONS
Unprecedented attention on public health due to the coronavirus disease 2019 pandemic has highlighted opportunities for system improvements, such as addressing the lack of a performance measurement system. This study provides actionable knowledge on conceptual, methodological, contextual, and infrastructure challenges needed to design and build a pan-Canadian performance measurement system for public health.

Identifiants

pubmed: 35906667
doi: 10.1186/s13690-022-00931-1
pii: 10.1186/s13690-022-00931-1
pmc: PMC9335461
doi:

Types de publication

Journal Article

Langues

eng

Pagination

177

Informations de copyright

© 2022. The Author(s).

Références

Health Serv Manage Res. 2002 May;15(2):126-37
pubmed: 12028801
J Public Health Manag Pract. 2000 Sep;6(5):66-77
pubmed: 11067663
Health Res Policy Syst. 2020 Jun 16;18(1):68
pubmed: 32546163
Healthc Policy. 2014 Sep;10(Spec issue):12-24
pubmed: 25305385
J Biomed Inform. 2016 Dec;64:87-92
pubmed: 27693565
J Public Health Manag Pract. 2003 May-Jun;9(3):179-82
pubmed: 12747313
Health Policy. 2016 Mar;120(3):273-80
pubmed: 26897247
Int J Qual Health Care. 2007 Dec;19(6):349-57
pubmed: 17872937
Annu Rev Public Health. 1997;18:261-82
pubmed: 9143720
Am J Public Health. 2001 Aug;91(8):1235-9
pubmed: 11499110
Am J Prev Med. 2009 Mar;36(3):266-72
pubmed: 19215852
Qual Health Res. 2005 Nov;15(9):1277-88
pubmed: 16204405
Health Res Policy Syst. 2019 Aug 9;17(1):79
pubmed: 31399114
Milbank Q. 2020 Jun;98(2):250-259
pubmed: 32333418
Healthc Policy. 2014 Sep;10(Spec issue):79-89
pubmed: 25305391
Health Policy. 2021 Dec;125(12):1517-1526
pubmed: 34666917
Adm Policy Ment Health. 2015 Sep;42(5):533-44
pubmed: 24193818
Am J Prev Med. 2015 Apr;48(4):480-7
pubmed: 25700654
Annu Rev Public Health. 2002;23:1-21
pubmed: 11910052

Auteurs

Meghan O'Neill (M)

Population Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Eric De Prophetis (E)

Population Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Sara Allin (S)

Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
North American Observatory on Health Systems and Policies, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Andrew D Pinto (AD)

Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Upstream Lab, MAP/Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Ontario, Canada.
Division of Clinical Public Health, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Department of Family and Community Medicine, St. Michael's Hospital, Toronto, Ontario, Canada.
Department of Family and Community Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.

Robert W Smith (RW)

Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
North American Observatory on Health Systems and Policies, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Social and Behavioural Health Sciences Division, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Erica Di Ruggiero (E)

Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Social and Behavioural Health Sciences Division, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Robert Schwartz (R)

Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Social and Behavioural Health Sciences Division, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Jasmine Pawa (J)

Division of Clinical Public Health, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.

Mehdi Ammi (M)

School of Public Policy and Administration, Carleton University, Ottawa, Ontario, Canada.

Laura C Rosella (LC)

Population Health Analytics Lab, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada. laura.rosella@utoronto.ca.
Laboratory Medicine and Pathobiology, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada. laura.rosella@utoronto.ca.
ICES, Toronto, Ontario, Canada. laura.rosella@utoronto.ca.
Institute for Better Health, Trillium Health Partners, Mississauga, Ontario, Canada. laura.rosella@utoronto.ca.

Classifications MeSH