Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review.
Determinants
Measurement
Psychometrics
Sustainability
Journal
Implementation science : IS
ISSN: 1748-5908
Titre abrégé: Implement Sci
Pays: England
ID NLM: 101258411
Informations de publication
Date de publication:
13 12 2022
13 12 2022
Historique:
received:
01
06
2022
accepted:
19
10
2022
entrez:
13
12
2022
pubmed:
14
12
2022
medline:
16
12
2022
Statut:
epublish
Résumé
Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings. Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed. A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants. This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field. This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.
Sections du résumé
BACKGROUND
Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.
METHODS
Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.
RESULTS
A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.
CONCLUSIONS
This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.
TRIAL REGISTRATION
This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.
Identifiants
pubmed: 36514059
doi: 10.1186/s13012-022-01252-1
pii: 10.1186/s13012-022-01252-1
pmc: PMC9746194
doi:
Types de publication
Systematic Review
Journal Article
Review
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
81Informations de copyright
© 2022. The Author(s).
Références
J Sch Psychol. 2021 Apr;85:140-154
pubmed: 33715778
Implement Sci. 2020 Sep 3;15(1):71
pubmed: 32883352
Qual Life Res. 2012 May;21(4):651-7
pubmed: 21732199
Transl Behav Med. 2021 Feb 11;11(1):11-20
pubmed: 31747021
Adm Policy Ment Health. 2012 Nov;39(6):419-25
pubmed: 21710257
Implement Sci. 2013 Feb 17;8:22
pubmed: 23414420
J Biomed Inform. 2009 Apr;42(2):377-81
pubmed: 18929686
Implement Sci. 2012 Mar 14;7:17
pubmed: 22417162
Rev Assoc Med Bras (1992). 2020 Oct;66(10):1383-1390
pubmed: 33174931
Implement Sci. 2020 Jun 19;15(1):47
pubmed: 32560661
Int J Qual Health Care. 2013 Apr;25(2):125-31
pubmed: 23422040
J Ment Health. 2018 Oct;27(5):395-401
pubmed: 29252043
Implement Sci. 2014 Apr 05;9(1):43
pubmed: 24708893
Prev Chronic Dis. 2014 Jan 23;11:130184
pubmed: 24456645
Adm Policy Ment Health. 2020 Nov;47(6):920-926
pubmed: 32107674
Implement Sci. 2020 Jan 6;15(1):4
pubmed: 31906983
Am J Public Health. 2011 Nov;101(11):2059-67
pubmed: 21940916
Health Educ Q. 1993 Summer;20(2):161-78
pubmed: 8491630
Implement Sci. 2016 Nov 8;11(1):148
pubmed: 27821146
Implement Sci. 2015 Nov 04;10:155
pubmed: 26537706
Implement Sci. 2018 Jan 19;13(1):17
pubmed: 29351767
Syst Rev. 2018 Apr 25;7(1):66
pubmed: 29695295
Am J Med Qual. 2008 May-Jun;23(3):193-200
pubmed: 18539980
BMJ Open. 2015 Dec 29;5(12):e008073
pubmed: 26715477
Implement Sci Commun. 2021 Jul 17;2(1):77
pubmed: 34274004
J Behav Health Serv Res. 2017 Jul;44(3):442-464
pubmed: 27048371
Front Digit Health. 2020 Nov 20;2:575951
pubmed: 34713047
Implement Sci. 2020 Oct 9;15(1):88
pubmed: 33036653
BMJ Open. 2017 Sep 24;7(9):e014417
pubmed: 28947436
Adm Policy Ment Health. 2020 Mar;47(2):188-196
pubmed: 31197625
Implement Sci. 2021 Aug 30;16(1):86
pubmed: 34461948
J Nurs Meas. 1998 Summer;6(1):19-33
pubmed: 9769609
Implement Sci. 2020 Aug 18;15(1):66
pubmed: 32811517
Implement Sci. 2012 Jul 16;7:65
pubmed: 22800294
Spine (Phila Pa 1976). 2000 Dec 15;25(24):3186-91
pubmed: 11124735
Implement Sci Commun. 2020 Sep 17;1:76
pubmed: 32964208
Am J Community Psychol. 2016 Sep;58(1-2):192-210
pubmed: 27624514
Implement Sci. 2011 Oct 06;6:116
pubmed: 21974914
Implement Sci. 2013 Oct 02;8:117
pubmed: 24088228
Implement Sci. 2021 Jun 12;16(1):62
pubmed: 34118955
Implement Sci. 2009 Aug 07;4:50
pubmed: 19664226
Adm Policy Ment Health. 2011 Jan;38(1):4-23
pubmed: 21197565
Implement Sci. 2017 Sep 2;12(1):110
pubmed: 28865479
Sch Psychol Q. 2014 Jun;29(2):125-137
pubmed: 24708284
Front Public Health. 2018 Jun 11;6:149
pubmed: 29942800
Implement Sci. 2013 Feb 01;8:15
pubmed: 23375082
J Med Internet Res. 2019 Feb 20;21(2):e12376
pubmed: 30785402
J Biomed Inform. 2019 Jul;95:103208
pubmed: 31078660
Annu Rev Public Health. 2018 Apr 1;39:55-76
pubmed: 29328872
Eval Program Plann. 2020 Apr;79:101781
pubmed: 31991309
BMC Health Serv Res. 2011 Sep 30;11:245
pubmed: 21961827
BMJ. 2021 Mar 29;372:n160
pubmed: 33781993
BMC Health Serv Res. 2011 Nov 16;11:314
pubmed: 22087884
BMC Med Res Methodol. 2018 Nov 15;18(1):135
pubmed: 30442094
Front Public Health. 2020 May 12;8:134
pubmed: 32478025
BMJ Open. 2017 Oct 08;7(10):e017972
pubmed: 28993392
Implement Sci. 2015 Jun 11;10:88
pubmed: 26062907
Adm Policy Ment Health. 2009 Sep;36(5):349-57
pubmed: 19499322
Qual Life Res. 2018 May;27(5):1159-1170
pubmed: 29550964
BMC Med Res Methodol. 2018 Nov 15;18(1):133
pubmed: 30442093
Implement Sci. 2018 Dec 4;13(1):146
pubmed: 30509289
Community Ment Health J. 2009 Jun;45(3):228-36
pubmed: 19306060
Int J Environ Res Public Health. 2021 Oct 29;18(21):
pubmed: 34769931