Feasibility and acceptability of a volunteer peer fidelity assessment model in early psychosis intervention programmes in Ontario: Results from a pilot study.
acceptability
early intervention
feasibility
programme fidelity
psychosis
Journal
Early intervention in psychiatry
ISSN: 1751-7893
Titre abrégé: Early Interv Psychiatry
Pays: Australia
ID NLM: 101320027
Informations de publication
Date de publication:
06 2021
06 2021
Historique:
revised:
14
01
2020
received:
11
03
2019
accepted:
15
03
2020
pubmed:
2
4
2020
medline:
25
2
2023
entrez:
2
4
2020
Statut:
ppublish
Résumé
Fidelity monitoring can support high-quality service delivery but is resource-intensive to implement. A fidelity assessment model utilizing volunteer assessors was trialled as a low-cost strategy for conducting fidelity assessments. This article reports on the acceptability and feasibility of this model. Twenty volunteer assessors were trained to conduct fidelity assessments in nine Early Psychosis Intervention programmes across Ontario, Canada. Assessments were conducted using the First-Episode Psychosis Services Fidelity Scale based on a 2-day site visit, during which assessors interviewed staff, clients and families; reviewed charts; observed a team meeting and reviewed programme materials. The model was evaluated based on assessor focus groups, programme interviews, consensus meeting data and time-tracking logs. General inductive analysis was used to code and synthesize qualitative data. Quantitative data were aggregated and summarized. Participant feedback was positive and indicated that use of peer assessors and the in-person site visit added value to the process. The model was perceived to provide valuable information to support internal quality improvement efforts. Assessors reported direct benefits from participating, including networking and learning opportunities. Key challenges were the high time demand on assessors and turnover in the assessor team. The volunteer peer fidelity model was perceived to be a valuable improvement process by participants, but the high cost and reliance on ongoing volunteerism makes its sustainability uncertain. Next steps may include exploring remote assessment strategies or direct payments, although these strategies risk reducing the acceptability, and therefore uptake, of the assessment.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
480-485Informations de copyright
© 2020 John Wiley & Sons Australia, Ltd.
Références
Addington, D., Birchwood, M., Jones, P., Killackey, E., McDaid, D., Melau, M., … Merete, N. (2018). Fidelity scales and performance measures to support implementation and quality assurance for first episode psychosis services. Early Intervention in Psychiatry, 12, 1235-1242. https://doi.org/10.1111/eip.12684
Addington, D. E., Norman, R., Bond, G. R., Sale, T., Melton, R., McKenzie, E., & Wang, J. (2016). Development and testing of the First-Episode Psychosis Services Fidelity Scale. Psychiatric Services, 67, 1023-1025. https://doi.org/10.1176/appi.ps.201500398
Archie, S., Hobbs, H., & Menezes, N. (2008). Translating best practices into service: implementing Early Intervention for Psychosis across Canada. Psychiatric Annals, 38, 544-558. https://doi.org/10.3928/00485713-20080801-01
Bond, G. R. (2013). Self-assessed fidelity: Proceed with caution. Psychiatric Services, 64(4), 393-394. https://doi.org/10.1176/appi.ps.640418
Breitenstein, S. M., Fogg, L., Garvey, C., Hill, C., Resnick, B., & Gross, D. (2010). Measuring implementation fidelity in a community-based parenting intervention. Nursing Research, 59, 158-165. https://doi.org/10.1097/NNR.0b013e3181dbb2e2
Cheng, C., Dewa, C. S., & Goering, P. (2011). Matryoshka Project: lessons learned about early intervention in psychosis programme development. Early Intervention in Psychiatry, 5, 64-69. https://doi.org/10.1111/j.1751-7893.2010.00255.x
Correll, C. U., Galling, B., Pawar, A., Krivko, A., Bonetto, C., Ruggeri, M., … Kane, J. M. (2018). Comparison of early intervention services vs treatment as usual for early-phase psychosis: A systematic review, meta-analysis, and meta-regression. JAMA Psychiatry, 75, 555-565. https://doi.org/10.1001/jamapsychiatry.2018.0623
Durbin, J., Selick, A., Hierlihy, D., Moss, S., & Cheng, C. (2016). A first step in system improvement: a survey of early psychosis intervention programmes in Ontario. Early Intervention in Psychiatry, 10, 485-483. https://doi.org/10.1111/eip.12201
Durbin, J., Selick, A., Langill, G., Cheng, C., Archie, S., Butt, S., & Addington, A. (2019). Using fidelity measurement to assess quality of early intervention services in Ontario. Psychiatric Services, 70(9), 840-844. https://doi.org/10.1176/appi.ps.201800581
Essock, S. M., Nossel, I. R., McNamara, K., Bennett, M. E., Buchanan, R. W., Kreyenbuhl, J. A., … Dixon, L. B. (2015). Practical monitoring of treatment fidelity: examples from a team-based intervention for people with early psychosis. Psychiatric Services, 66, 674-676. https://doi.org/10.1176/appi.ps.201400531
Gilmer, T. P., Stefancic, A., Sklar, M., & Tsemberis, S. (2013). Development and validation of a Housing First fidelity survey. Psychiatric Services, 64(9), 911-914.
International Early Psychosis Association Writing Group. (2005). International clinical practice guidelines for early psychosis. The British Journal of Psychiatry. Supplement, 48, s120-s124.
Margolies, P. J., Humensky, J. L., Chiang, I.-C., Covell, N. H., Broadway-Wilson, K., Gregory, R., … Dixon, L. B. (2017). Is There a Role for Fidelity Self-Assessment in the Individual Placement and Support Model of Supported Employment? Psychiatric Services, 68(9), 975-978. https://doi.org/10.1176/appi.ps.201600264
McGrew, J. H., Stull, L. G., Rollins, A. L., Salyers, M. P., & Hicks, L. J. (2011). A comparison of phone-based and on-site assessment of fidelity for Assertive Community Treatment in Indiana. Psychiatric Services, 62, 670-674.
McGrew, J. H., White, L. M., Stull, L. G., & Wright-Berryman, J. (2013). A Comparison of self-reported and phone-administered methods of ACT fidelity assessment: A pilot study in Indiana. Psychiatric Services, 64, 272-276.
Nordentoft, M., Rasmussen, J. O., Melau, M., Hjorthøj, C. R., & Thorup, A. A. (2014). How successful are first episode programs? A review of the evidence for specialized assertive early intervention. Current Opinion in Psychiatry, 27, 167-172. https://doi.org/10.1097/YCO.0000000000000052
Ontario Ministry of Health and Long Term Care. (2011). Early Psychosis Intervention Program Standards. Toronto, Ontario: Ontario Ministry of Health and Long Term Care.
Rollins, A. L., Kukla, M., Salyers, M. P., McGrew, J. H., Flanagan, M. E., Leslie, D. L., … McGuire, A. B. (2017). Comparing the costs and acceptability of three fidelity assessment methods for Assertive Community Treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44, 810-816. https://doi.org/10.1007/s10488-016-0785-7
Rollins, A. L., McGrew, J. H., Kukla, M., McGuire, A. B., Flanagan, M. E., Hunt, M. G., … Salyers, M. P. (2016). Comparison of Assertive Community Treatment fidelity assessment methods: reliability and validity. Administration and Policy in Mental Health and Mental Health Services Research, 43, 157-167. https://doi.org/10.1007/s10488-015-0641-1
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32-43. https://doi.org/10.1007/s10488-010-0321-0
Taut, S. M., & Alkin, M. C. (2003). Program Staff Perceptions of Barriers to Evaluation Implementation. American Journal of Evaluation, 24, 213-226. https://doi.org/10.1016/S1098-2140(03)00028-6
Thomas, D. R. (2006). A General Inductive Approach for Analyzing Qualitative Evaluation Data. American Journal of Evaluation, 27, 237-246. https://doi.org/10.1177/1098214005283748