Development and validation of the Trust in Government measure (TGM).
Federal
Government
Measure
OECD
Trust
Validation
Journal
BMC public health
ISSN: 1471-2458
Titre abrégé: BMC Public Health
Pays: England
ID NLM: 100968562
Informations de publication
Date de publication:
17 10 2023
17 10 2023
Historique:
received:
05
07
2023
accepted:
12
10
2023
medline:
23
10
2023
pubmed:
18
10
2023
entrez:
17
10
2023
Statut:
epublish
Résumé
Trust in government is associated with health behaviours and is an important consideration in population health interventions. While there is a reported decline in public trust in government across OECD countries, the tools used to measure trust are limited in their use for informing action to (re)build trust, and have limitations related to reliability and validity. To address the limitations of existing measures available to track public trust, the aim of the present work was to develop a new measure of trust in government. Fifty-six qualitative interviews (Aug-Oct 2021; oversampling for equity-deserving populations) were conducted to design a national survey, including factor analyses and validation testing (N = 878; June 1-14th 2022) in Canada. The measure demonstrated strong internal consistency (α = 0.96) and test validity (CFI = 0.96, RMSEA = 0.09, SRMR = 0.03), suggesting that trust in government can be measured as a single underlying construct. It also demonstrated strong criterion validity, as measured by significant (p < 0.0001) associations of scores with vaccine hesitancy, vaccine conspiracy beliefs, COVID-19 conspiracy beliefs, trust in public health messaging about COVID-19, and trust in public health advice about COVID-19. We present the Trust in Government Measure (TGM); a 13-item unidimensional measure of trust in Federal government. This measure can be used within high-income countries, particularly member countries within the OECD already in support of using tools to collect, publish and compare statistics. Our measure should be used by researchers and policy makers to measure trust in government as a key indicator of societal and public health.
Sections du résumé
BACKGROUND
Trust in government is associated with health behaviours and is an important consideration in population health interventions. While there is a reported decline in public trust in government across OECD countries, the tools used to measure trust are limited in their use for informing action to (re)build trust, and have limitations related to reliability and validity. To address the limitations of existing measures available to track public trust, the aim of the present work was to develop a new measure of trust in government.
METHODS
Fifty-six qualitative interviews (Aug-Oct 2021; oversampling for equity-deserving populations) were conducted to design a national survey, including factor analyses and validation testing (N = 878; June 1-14th 2022) in Canada.
RESULTS
The measure demonstrated strong internal consistency (α = 0.96) and test validity (CFI = 0.96, RMSEA = 0.09, SRMR = 0.03), suggesting that trust in government can be measured as a single underlying construct. It also demonstrated strong criterion validity, as measured by significant (p < 0.0001) associations of scores with vaccine hesitancy, vaccine conspiracy beliefs, COVID-19 conspiracy beliefs, trust in public health messaging about COVID-19, and trust in public health advice about COVID-19. We present the Trust in Government Measure (TGM); a 13-item unidimensional measure of trust in Federal government.
CONCLUSIONS
This measure can be used within high-income countries, particularly member countries within the OECD already in support of using tools to collect, publish and compare statistics. Our measure should be used by researchers and policy makers to measure trust in government as a key indicator of societal and public health.
Identifiants
pubmed: 37848848
doi: 10.1186/s12889-023-16974-0
pii: 10.1186/s12889-023-16974-0
pmc: PMC10583387
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
2023Informations de copyright
© 2023. BioMed Central Ltd., part of Springer Nature.
Références
Ward PR. Improving Access to, Use of, and outcomes from Public Health Programs: the importance of building and maintaining Trust with Patients/Clients. Front Public Health. 2017;(March).
Birkhäuer J, Gaab J, Kossowsky J, Hasler S, Krummenacher P, Werner C et al. Trust in the health care professional and health outcome: a meta-analysis. PLoS ONE. 2017;12(2).
Bollyky TJ, Hulland EN, Barber RM, Collins JK, Kiernan S, Moses M, et al. Pandemic preparedness and COVID-19: an exploratory analysis of Infection and fatality rates, and contextual factors associated with preparedness in 177 countries, from Jan 1, 2020, to Sept 30, 2021. The Lancet. 2022;6736(22):1–24.
Rothstein B, Stolle D. In: Castiglione D, van Deth JW, Wolleb G, editors. The handbook of social capital. The Handbo. Oxford: Oxford University Press; 2008. pp. 273–302.
Spadaro G, Gangl K, van Prooijen JW, van Lange PAM, Mosso CO. Enhancing feelings of security: how institutional trust promotes interpersonal trust. PLoS ONE. 2020;15(9 September):1–22.
Algan Y, Cahuc P. Trust, Growth, and Well-Being: new evidence and policy implications. Handb Economic Growth. 2014;2(7464):49–120.
doi: 10.1016/B978-0-444-53538-2.00002-2
OECD. Trust in Government [Internet]. Available from: https://www.oecd.org/gov/trust-in-government.htm .
Marlow LAV, Waller J, Wardle J. Trust and experience as predictors of HPV vaccine acceptance. Hum Vaccin. 2007;3(5):171–5.
doi: 10.4161/hv.3.5.4310
pubmed: 17622801
Moucheraud C, Guo H, Macinko J. Trust in governments and health workers low globally, influencing attitudes toward health information, vaccines. Health Affairs (Millwood). 2021;40(8):1215–24.
doi: 10.1377/hlthaff.2020.02006
Van Der Weerd W, Timmermans DRM, Beaujean DJMA, Oudhoff J, Van Steenbergen JE. Monitoring the level of government trust, risk perception and intention of the general public to adopt protective measures during the influenza A (H1N1) pandemic in the Netherlands. BMC Public Health [Internet]. 2011;11(1):575. Available from: http://www.biomedcentral.com/ 1471-2458/11/575.
Wang Q, Yang L, Jin H, Lin L. Vaccination against COVID-19: A systematic review and meta-analysis of acceptability and its predictors. Prev Med (Baltim) [Internet]. 2021;150(June):106694. https://doi.org/10.1016/j.ypmed.2021.106694 .
Dohle S, Wingen T, Schreiber M. Acceptance and adoption of protective measures during the COVID-19 pandemic: the role of trust in politics and trust in science. Social Psychol Bull. 2020;15(4).
Gotanda H, Miyawaki A, Tabuchi T, Tsugawa Y. Association between Trust in Government and Practice of Preventive measures during the COVID-19 pandemic in Japan. J Gen Intern Med. 2021;36(11):3471–7.
doi: 10.1007/s11606-021-06959-3
pubmed: 34159544
pmcid: 8218973
Han Q, Zheng B, Cristea M, Agostini M, Belanger JJ, Gutzkow B et al. Trust in government regarding COVID-19 and its associations with preventive health behaviour and prosocial behaviour during the pandemic: a cross-sectional and longitudinal study. Psychol Med. 2021.
Shanka MS, Menebo MM. When and How Trust in Government Leads to Compliance with COVID-19 Precautionary Measures. J Bus Res [Internet]. 2022;139(July 2020):1275–83. https://doi.org/10.1016/j.jbusres.2021.10.036 .
Majid U, Wasim A, Truong J, Bakshi S. Public trust in governments, health care providers, and the media during pandemics: A systematic review. Journal of Trust Research [Internet]. 2022;0(0):1–23. https://doi.org/10.1080/21515581.2022.2029742 .
Edelman. 2021 Edelman Trust Barometer: Canada. 2021.
Proof Strategies. 2021 Proof Strategies CanTrust Index [Internet]. 2021. Available from: https://getproof.com/what-we-do/cantrust/ .
Proof Strategies. 2022 Proof Strategies CanTrust Index [Internet]. 2022. Available from: https://getproof.com/what-we-do/cantrust/ .
Levitt EE, Gohari MR, Syan SK, Belisario K, Gillard J, DeJesus J et al. Public health guideline compliance and perceived government effectiveness during the COVID-19 pandemic in Canada: Findings from a longitudinal cohort study. The Lancet Regional Health - Americas [Internet]. 2022;9:100185. https://doi.org/10.1016/j.lana.2022.100185 .
Lazarus JV, Ratzan SC, Palayew A, Gostin LO, Larson HJ, Rabin K, et al. A global survey of potential acceptance of a COVID-19 vaccine. Nat Med. 2021;27(2):225–8.
doi: 10.1038/s41591-020-1124-9
pubmed: 33082575
Allington D, McAndrew S, Moxham-Hall V, Duffy B. Coronavirus conspiracy suspicions, general vaccine attitudes, trust, and coronavirus information source as predictors of vaccine hesitancy among UK residents during the COVID-19 pandemic. Psychol Med. 2021;(2021).
Karić T, Međedović J. Covid-19 Conspiracy beliefs and containment-related behaviour: the role of political trust. Pers Individ Dif. 2021;175.
American National Election Studies. ANES Question Search-Trust [Internet]. [cited 2023 May 28]. Available from: https://electionstudies.org/data-tools/anes-question-search/ .
Kerr JR, Schneider CR, Recchia G, Dryhurst S, Sahlin U, Dufouil C et al. Correlates of intended COVID-19 vaccine acceptance across time and countries: results from a series of cross-sectional surveys. BMJ Open. 2021;11(8).
Jennings W, Stoker G, Valgarðsson V, Devine D, Gaskell J. How trust, mistrust and distrust shape the governance of the COVID-19 crisis. J Eur Public Policy. 2021;28(8):1174–96.
doi: 10.1080/13501763.2021.1942151
Lindholt MF, Jørgensen F, Bor A, Petersen MB. Public acceptance of COVID-19 vaccines: cross-national evidence on levels and individual-level predictors using observational data. BMJ Open. 2021;11(6).
Devine D, Gaskell J, Jennings W, Stoker G. Exploring Trust, Mistrust and Distrust. 2020.
Jennings W, Stoker G, Bunting H, Valgarõsson VO, Gaskell J, Devine D et al. Lack of trust, Conspiracy beliefs, and social media use predict COVID-19 vaccine hesitancy. Vaccines (Basel). 2021;9(6).
World Values Survey. World Values Survey Wave 7-Canada [Internet]. Available from: http://www.worldvaluessurvey.org .
Murtin F, Fleischer L, Siegerink V. Trust and its determinants: Evidence from the Trustlab experiment [Internet]. 2018 Jun. Available from: www.oecd.org/sdd/publicationsdocuments/workingpapers/ .
Edelman. Edelman Trust Barometer [Internet]. Available from: https://www.edelman.com/trust/2022-trust-barometer .
Proof Strategies. Proof Stratefies CanTrust Index [Internet]. Available from: https://getproof.com/what-we-do/cantrust/ .
Eisenman DP, Williams MV, Glik D, Long A, Plough AL, Ong M. The Public Health Disaster Trust Scale: validation of a brief measure. Public Health Management Pract. 2012;18(4):E11–8.
doi: 10.1097/PHH.0b013e31823991e8
Rozek LS, Jones P, Menon A, Hicken A, Apsley S, King EJ. Understanding vaccine hesitancy in the Context of COVID-19: the role of Trust and confidence in a seventeen-country survey. Int J Public Health. 2021;66:636255.
doi: 10.3389/ijph.2021.636255
pubmed: 34744589
pmcid: 8565283
Song AM, Saavedra Cisneros A, Temby O, Sandall J, Cooksey RW, Hickey GM. On developing an Inter-agency Trust Scale for Assessing Governance Networks in the Public Sector. Int Public Manage J. 2019;22(4):691–710.
doi: 10.1080/10967494.2017.1370047
Stephenson LB, Harell A, Rubenson D, Loewen PJ. The 2021 Canadian Election Study. [dataset]. 2022.
Grimmelikhuijsen S, Knies E. Validating a scale for citizen trust in government organizations. Int Rev Admin Sci. 2017;83(3):583–601.
doi: 10.1177/0020852315585950
Meyer S, Ward P, Rogers W, Meyer S, Ward P, Coveney J, et al. Trust in the health system: an analysis and extension of the social theories of Giddens and Luhmann. Health Sociol Rev. 2008;17(2):177–86.
doi: 10.5172/hesr.451.17.2.177
Herati H, Burns KE, Nascimento M, Brown P, Calnan M, Dubé E, et al. Canadians’ trust in government in a time of crisis: does it matter? PLoS One. 2023;18(9):e0290664.
Bornstein BH, Tomkins AJ. Motivating Cooperation and Compliance with Authority. The Role of Institutional Trust. Bornstein BH, Tomkins AJ, editors. Vol. 62, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation. 2015. vii.
Devos T, Spini D, Schwartz SH. Conflicts among human values and trust in institutions. Br J Soc Psychol. 2002;41(4):481–94.
doi: 10.1348/014466602321149849
pubmed: 12593749
Holroyd TA, Limaye RJ, Gerber JE, Rimal RN, Musci RJ, Brewer J et al. Development of a Scale to Measure Trust in Public Health Authorities: Prevalence of Trust and Association with Vaccination. J Health Commun [Internet]. 2021;26(4):272–80. https://doi.org/10.1080/10810730.2021.1927259 .
Aboueid SE, Herati H, Nascimento MHG, Ward PR, Brown P, Calnan M, et al. How do you measure trust in social institutions and health professionals? A systematic review of the literature (2012–2021). Sociol Compass. 2023. https://doi.org/10.1111/soc4.13101 .
McEvily B, Tortoriello M. Measuring trust in organisational research: review and recommendations. J Trust Res. 2011;1(1):23–63.
Ike N, Burns K, Nascimento M, Filice E, Ward PR, Herati H, et al. Examining factors impacting acceptance of COVID-19 countermeasures among structurally marginalised Canadians. Global Public Health. 2023;18(1):1–16.
Nascimento MHG, Dube E, Burns KE, Brown P, Calnan M, Ward PR, et al. Informing efforts beyond tailored promotional campaigns by understanding contextual factors shaping vaccine hesitancy among equity-deserving populations in Canada: an exploratory qualitative study. Int J Health Equity. 2023;22(209):1–13.
World Values S, VALUES SURVEY WAVE 7 MASTER SURVEY QUESTIONNAIRE [Internet]. 2017–2021 WORLD. Available from: file:///C:/Users/katie/Downloads/F00010738-WVS-7_Master_Questionnaire_2017–2020_English.pdf%0A%0A.
Akel KB, Masters NB, Shih SF, Lu Y, Wagner AL. Modification of a vaccine hesitancy scale for use in adult vaccinations in the United States and China. Hum Vaccin Immunother [Internet]. 2021;17(8):2639–46. https://doi.org/10.1080/21645515.2021.1884476 .
Shapiro GK, Holding A, Perez S, Amsel R, Rosberger Z. Validation of the vaccine conspiracy beliefs scale. Papillomavirus Research [Internet]. 2016;2(May):167–72. https://doi.org/10.1016/j.pvr.2016.09.001 .
Hamilton K, Hagger MS. The Vaccination Concerns in COVID-19 Scale (VaCCS): Development and validation [Internet]. Vol. 17, PLoS ONE. 2022. 1–33 p. https://doi.org/10.1371/journal.pone.0264784 .
Imhoff R, Lamberty P. A bioweapon or a hoax? The link between distinct Conspiracy beliefs about the Coronavirus Disease (COVID-19) outbreak and pandemic behavior. Soc Psychol Personal Sci. 2020;11(8):1110–8.
doi: 10.1177/1948550620934692
pmcid: 7342934
Kowitt SD, Schmidt AM, Hannan A, Goldstein AO. Awareness and trust of the FDA and CDC: results from a national sample of US adults and adolescents. PLoS ONE. 2017;12(5):1–14.
doi: 10.1371/journal.pone.0177546
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.
doi: 10.1080/10705519909540118
Browne MW, Cudeck R. Alternative ways of assessing Model Fit. Sociol Mthods Res. 1992;21(2):230–58.
doi: 10.1177/0049124192021002005
Suhr DD. Exploratory or confirmatory factor analysis [Internet]. SAS Support Resources. Available from: https://support.sas.com/resources/papers/proceedings/proceedings/sugi31/200-31.pdf .
Worthington RL, Whittaker TA. Scale Development Research: a content analysis and recommendations for best practices. Couns Psychol. 2006;34(6):806–38.
doi: 10.1177/0011000006288127
Kaiser MO. Kaiser-Meyer-Olkin measure for identity correlation matrix. J Roy Stat Soc. 1974;52(1):296–289.
Bartlett MS. The effect of standardization N on a χ2 approximation in factor analysis. Biometrika. 1951;38(3–4):337–44.
Dziuban CD, Shirkey EC. When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychol Bull. 1974;81(6):358–61.
doi: 10.1037/h0036316
Watkins MW. Exploratory factor analysis: a guide to best practice. J Black Psychol. 2018;44(3):219–46.
doi: 10.1177/0095798418771807
Curran PJ, West SG, Finch JF. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychol Methods. 1996;1(1):16–29.
doi: 10.1037/1082-989X.1.1.16
Smets A, Hooghe M, Quintelier E. The scale validity of trust in political institutions measurements over time in Belgium. An analysis of the European Social Survey, 2002–2010 [Internet]. Ljubljana; 2013. Available from: https://limo.libis.be/primo-explore/fulldisplay?docid=LIRIAS1861625 &context=L&vid=Lirias&search_scope=Lirias&tab=default_tab&fromSitemap=1.
Taylor LA, Nong P, Platt J. Fifty Years of Trust Research in Health Care: A Synthetic Review. Milbank Q. 2023.
Granovetter M. Economic Action and Social Structure: The Problem of Embeddedness. American Journal of Sociology [Internet]. 1985;91(3):481–510. Available from: http://about.jstor.org/terms .
Government of Canada. The constitutional distribution of legislative powers. 2021.
Van Elsas E. Political Trust as a Rational Attitude: A Comparison of the Nature of Political Trust across Different Levels of Education. 2014.
Hwang M. Ethnicity and Political Trust in Canada: is there a deepening divide? Can J Sociol. 2017;42(1).
OECD. How does Canada compare ? A spotlight on LGBT people. OECD Health Statistics 2014. 2019.
Statistics Canada. Impacts on Immigrants and People Designated as Visible Minorities [Internet]. 2020. Available from: https://www150.statcan.gc.ca/n1/pub/11-631-x/2020004/s6-eng.htm .
Catterberg G, Moreno A. The Individual Bases of Political Trust: Trends in New and established democracies. Int J Public Opin Res. 2005;18(1):31–48.
doi: 10.1093/ijpor/edh081
Christensen T, Lægreid P. Trust in Government: The Relative Importance of Service Satisfaction, Political Factors, and Demography: Public Performance & Management Review: Vol 28, No 4. Public Performance & Management Review. 2005;28(4):487–511.
OECD. Governance for Youth, Trust and Intergenerational Justice: Fit for All Generations? [Internet]. Paris. ; 2020. Available from: https://www.oecd-ilibrary.org/governance/governance-for-youth-trust-and-intergenerational-justice_c3e5cb8a-en .
Crenshaw K. Mapping the margins: intersectionality, identity politics, and Violence against women of color. Stanford Law Rev. 1990;43(6):1241–99.
doi: 10.2307/1229039
Calnan MW, Sanford E. Public trust in health care: the system or the doctor? Qual Saf Health Care. 2004;13(2):92–7.
doi: 10.1136/qshc.2003.009001
pubmed: 15069214
pmcid: 1743818
Rieger MO, Wang M. Trust in Government Actions During the COVID-19 Crisis. Soc Indic Res [Internet]. 2021;(0123456789). https://doi.org/10.1007/s11205-021-02772-x .