Developing an implementation fidelity checklist for a vocational rehabilitation intervention.
Complex interventions
Measurement Development
Occupational therapy
Treatment fidelity
Vocational rehabilitation
Journal
Pilot and feasibility studies
ISSN: 2055-5784
Titre abrégé: Pilot Feasibility Stud
Pays: England
ID NLM: 101676536
Informations de publication
Date de publication:
02 Nov 2022
02 Nov 2022
Historique:
received:
08
06
2022
accepted:
17
10
2022
entrez:
3
11
2022
pubmed:
4
11
2022
medline:
4
11
2022
Statut:
epublish
Résumé
Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fidelity checklist for measuring the implementation fidelity of an early, stroke-specialist vocational rehabilitation intervention (ESSVR) in the RETAKE trial. To develop the fidelity measure, previous checklists were reviewed to inform the assessment structure, and core intervention components were extracted from intervention descriptions into a checklist, which was ratified by eight experts in fidelity measurement and complex interventions. Guidance notes were generated to assist with checklist completion. To test the measure, two researchers independently applied the checklist to fifteen stroke survivor intervention case notes using retrospective observational case review. The scoring was assessed for interrater reliability. A fidelity checklist containing 21 core components and 6 desirable components across 4 stages of intervention delivery was developed with corresponding guidance notes. Interrater reliability of each checklist item ranged from moderate to perfect (Cohen's kappa 0.69-1). The resulting checklist to assess implementation fidelity is fit for assessing the delivery of vocational rehabilitation for stroke survivors using retrospective observational case review. The checklist proved its utility as a measure of fidelity and may be used to inform the design of future implementation strategies. ISRCTN, ISRCTN12464275. Registered on 13 March 2018.
Sections du résumé
BACKGROUND
BACKGROUND
Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fidelity checklist for measuring the implementation fidelity of an early, stroke-specialist vocational rehabilitation intervention (ESSVR) in the RETAKE trial.
METHODS
METHODS
To develop the fidelity measure, previous checklists were reviewed to inform the assessment structure, and core intervention components were extracted from intervention descriptions into a checklist, which was ratified by eight experts in fidelity measurement and complex interventions. Guidance notes were generated to assist with checklist completion. To test the measure, two researchers independently applied the checklist to fifteen stroke survivor intervention case notes using retrospective observational case review. The scoring was assessed for interrater reliability.
RESULTS
RESULTS
A fidelity checklist containing 21 core components and 6 desirable components across 4 stages of intervention delivery was developed with corresponding guidance notes. Interrater reliability of each checklist item ranged from moderate to perfect (Cohen's kappa 0.69-1).
CONCLUSIONS
CONCLUSIONS
The resulting checklist to assess implementation fidelity is fit for assessing the delivery of vocational rehabilitation for stroke survivors using retrospective observational case review. The checklist proved its utility as a measure of fidelity and may be used to inform the design of future implementation strategies.
TRIAL REGISTRATION
BACKGROUND
ISRCTN, ISRCTN12464275. Registered on 13 March 2018.
Identifiants
pubmed: 36324137
doi: 10.1186/s40814-022-01194-x
pii: 10.1186/s40814-022-01194-x
pmc: PMC9628165
doi:
Types de publication
Journal Article
Langues
eng
Pagination
234Subventions
Organisme : Health Technology Assessment Programme
ID : 15/130/11
Informations de copyright
© 2022. The Author(s).
Références
Annu Rev Psychol. 2000;51:345-75
pubmed: 10751975
J Occup Rehabil. 2005 Dec;15(4):507-24
pubmed: 16254752
J Caring Sci. 2015 Jun 01;4(2):165-78
pubmed: 26161370
Int J Qual Health Care. 2006 Oct;18(5):377-82
pubmed: 16951425
BMC Med Res Methodol. 2021 Oct 3;21(1):203
pubmed: 34602054
Pilot Feasibility Stud. 2022 Jul 29;8(1):160
pubmed: 35906683
Am J Prev Med. 2009 May;36(5):452-7
pubmed: 19362699
Patient Educ Couns. 2004 Jul;54(1):107-18
pubmed: 15210268
Res Nurs Health. 2010 Apr;33(2):164-73
pubmed: 20198637
Am J Phys Med Rehabil. 2012 Aug;91(8):715-24
pubmed: 22377824
Implement Sci. 2012 Apr 24;7:37
pubmed: 22530986
J Dermatolog Treat. 2013 Feb;24(1):50-9
pubmed: 22007701
Biochem Med (Zagreb). 2012;22(3):276-82
pubmed: 23092060
BMC Geriatr. 2019 Dec 23;19(1):364
pubmed: 31870306
Adm Policy Ment Health. 2011 Jan;38(1):32-43
pubmed: 20957425
BMJ Open. 2022 Mar 15;12(3):e053111
pubmed: 35292493
Health Educ Res. 2003 Apr;18(2):237-56
pubmed: 12729182
Top Stroke Rehabil. 2011 Sep-Oct;18(5):562-72
pubmed: 22082705
Br J Health Psychol. 2020 Feb;25(1):39-60
pubmed: 31693797
Implement Sci. 2013 Apr 04;8:40
pubmed: 23557119
BMJ. 2008 Sep 29;337:a1655
pubmed: 18824488
Child Care Health Dev. 2008 May;34(3):391-400
pubmed: 18410645
Int J Behav Med. 2015 Jun;22(3):345-55
pubmed: 24866259
Implement Sci. 2007 Nov 30;2:40
pubmed: 18053122
Am J Occup Ther. 2018 Sep/Oct;72(5):7205205050p1-7205205050p10
pubmed: 30157017
Clin Rehabil. 2015 Jul;29(7):663-73
pubmed: 25322870
Trials. 2020 Dec 9;21(1):1010
pubmed: 33298162
BMJ. 2014 Mar 07;348:g1687
pubmed: 24609605
Neuropsychol Rehabil. 2009 Dec;19(6):824-40
pubmed: 19544183
Implement Sci. 2009 Aug 07;4:50
pubmed: 19664226
Res Nurs Health. 2003 Oct;26(5):335-6
pubmed: 14579254
J Public Health Dent. 2011 Winter;71 Suppl 1:S52-63
pubmed: 21656954
Br J Health Psychol. 2017 Nov;22(4):872-903
pubmed: 28762607
Clin Psychol Rev. 1998 Jan;18(1):23-45
pubmed: 9455622
Brain Inj. 2015;29(3):320-8
pubmed: 25409342
BMC Med Res Methodol. 2019 Mar 15;19(1):59
pubmed: 30876403
Ann Fam Med. 2005 Jan-Feb;3(1):73-81
pubmed: 15671195
BMC Health Serv Res. 2016 Nov 18;16(1):663
pubmed: 27863484
J Eval Clin Pract. 2014 Aug;20(4):445-52
pubmed: 24840165
Top Stroke Rehabil. 2017 Jul;24(5):374-380
pubmed: 28218020
Health Psychol. 2004 Sep;23(5):443-51
pubmed: 15367063
Implement Sci. 2010 Sep 03;5:67
pubmed: 20815872
Int J Stroke. 2017 Jul;12(5):472-479
pubmed: 28697706
BMJ Open. 2016 Jan 06;6(1):e008900
pubmed: 26739723
Am J Prev Med. 2001 Jan;20(1 Suppl):38-47
pubmed: 11146259