Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project.
attitudes
community psychiatry
measurement-based care
mental health
providers
routine outcome monitoring (ROM)
Journal
Journal of evaluation in clinical practice
ISSN: 1365-2753
Titre abrégé: J Eval Clin Pract
Pays: England
ID NLM: 9609066
Informations de publication
Date de publication:
Aug 2021
Aug 2021
Historique:
revised:
10
07
2020
received:
28
04
2020
accepted:
19
07
2020
pubmed:
14
8
2020
medline:
12
8
2021
entrez:
14
8
2020
Statut:
ppublish
Résumé
Although mental health clinics are under increasing pressure to demonstrate value and routine outcome monitoring (ROM) has become a mandated component of care, providers have been slow to adopt ROM into practice, with some estimating that less than 20% of mental health clinicians use it consistently in the United States. This article explores perceived barriers and facilitators to integrating ROM into practice among clinicians and administrators in a large urban US community psychiatry clinic. One hundred and thirty-eight clinical and administrative staff were administered an anonymous web-based survey to elicit attitudes towards ROM. Responses were summarized descriptively and qualitatively synthesized into a conceptual model using inductive thematic analysis. Common barriers to integration included insufficient time to collect and/or use measures, not knowing what measures to use, measures being difficult to access, and insufficient training. Facilitators included increased access/ease of use, training and support, measure relevance/validity, and accountability. In order for psychiatry clinics to successfully implement ROM into practice, they must diagnose organization-side barriers and translate this knowledge into actionable quality improvement initiatives ranging from the infrastructural to the cultural.
Sections du résumé
BACKGROUND AND AIMS
OBJECTIVE
Although mental health clinics are under increasing pressure to demonstrate value and routine outcome monitoring (ROM) has become a mandated component of care, providers have been slow to adopt ROM into practice, with some estimating that less than 20% of mental health clinicians use it consistently in the United States. This article explores perceived barriers and facilitators to integrating ROM into practice among clinicians and administrators in a large urban US community psychiatry clinic.
METHOD
METHODS
One hundred and thirty-eight clinical and administrative staff were administered an anonymous web-based survey to elicit attitudes towards ROM. Responses were summarized descriptively and qualitatively synthesized into a conceptual model using inductive thematic analysis.
RESULTS
RESULTS
Common barriers to integration included insufficient time to collect and/or use measures, not knowing what measures to use, measures being difficult to access, and insufficient training. Facilitators included increased access/ease of use, training and support, measure relevance/validity, and accountability.
CONCLUSIONS
CONCLUSIONS
In order for psychiatry clinics to successfully implement ROM into practice, they must diagnose organization-side barriers and translate this knowledge into actionable quality improvement initiatives ranging from the infrastructural to the cultural.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
767-775Informations de copyright
© 2020 John Wiley & Sons Ltd.
Références
Lambert MJ, Harmon KL. The merits of implementing routine outcome monitoring in clinical practice. Clin Psychol Sci Pract. 2018;25(4):e12268.
Brattland H, Koksvik JM, Burkeland O, et al. The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: a randomized clinical trial. J Couns Psychol. 2018;65(5):641-652.
Fortney JC, Unutzer J, Wrenn G, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179-188.
Goldberg SB, Babins-Wagner B, Rousmaniere T, et al. Creating a climate for therapist improvement: a case study of an agency focused on outcomes and deliberate practice. Psychotherapy. 2016;53:367-375.
Boswell JF, Kraus DR, Miller S, Lambert MJ. Implementing routine outcome assessment in clinical practice: benefits, challenges, and solutions. Psychother Res. 2015;25:6-19.
Krägeloh CU, Czuba KJ, Billington DR, Kersten P, Siegert RJ. Using feedback from patient-reported outcome measures in mental health services: a scoping study and typology. Psychiatr Serv. 2015;66:224-241.
Hansson H, Rundberg J, Österling A, Öjehagen A, Berglund M. Intervention with feedback using Outcome Questionnaire 45 (OQ-45) in a Swedish psychiatric outpatient population: a randomized controlled trial. Nord J Psychiatry. 2013;67:274-281.
Carlier IV, Meuldijk D, Van Vliet IM, Van Fenema E, Van der Wee NJ, Zitman FG. ROM and feedback on physical or mental health status: evidence and theory. J Eval Clin Pract. 2012;18:104-110.
Youn SJ, Kraus DR, Castonguay LG. The treatment outcome package: facilitating practice and clinically relevant research. Psychotherapy. 2012;49:115-122.
Murphy KP, Rashleigh CM, Timulak L. The relationship between progress feedback and therapeutic outcome in student counseling: a randomised control trial. Couns Psychol Q. 2012;25:1-18.
Simon W, Lambert MJ, Harris MW, Busath G, Vazquez A. Providing patient progress information and clinical support tools to therapists: effects on patients at risk of treatment failure. Psychother Res. 2012;22:638-647.
Lambert MJ, Shimokawa K. Collecting client feedback. Psychotherapy. 2011;48:72-79.
Miller SD. Psychometrics of the ORS and SRS. Results from RCTs and Meta-Analyses of Routine Outcome Monitoring and Feedback. The Available Evidence. 2011. www.slideshare.net/scottdmiller/measures-and-feedback-January-2011. Accessed on April 27, 2020.
Bickman L, Kelley SD, Breda C, de Andrade AR, Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatr Serv. 2011;62:1423-1429.
Shimokawa K, Lambert MJ, Smart DW. Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. J Consult Clin Psychol. 2010;78:298-311.
Lambert MJ. Prevention of Treatment Failure: The Use of Measuring, Monitoring, and Feedback in Clinical Practice. Washington, DC: American Psychological Association Press; 2010.
Reese RJ, Toland MD, Slone NC, Norsworthy LA. Effect of client feedback on couple psychotherapy outcomes. Psychotherapy. 2010;47:616-630.
Anker MG, Duncan BL, Sparks JA. Using client feedback to improve couple therapy outcomes. A randomized clinical trial in a naturalistic setting. J Consult Clin Psychol. 2009;77:693-704.
Knaup C, Koesters M, Schoefer D, Becker T, Puschner B. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatry. 2009;195:15-22.
Reese RJ, Norsworthy LA, Rowlands SR. Does a continuous feedback system improve psychotherapy outcome? Psychotherapy. 2009;46:418-431.
Slade K, Lambert MJ, Harmon SC, Smart DW, Bailey R. Improving psychotherapy outcome: the use of immediate electronic feedback and revised clinical support tools. Clin Psychol Psychother. 2008;15:287-303.
Harmon SC, Lambert MJ, Smart DM, et al. Enhancing outcome for potential treatment failures: therapist-client feedback and clinical support tools. Psychother Res. 2007;17:379-392.
Brodey BB, Cuffel B, McCulloch J, et al. The acceptability and effectiveness of patient-reported assessments and feedback in a managed behavioral healthcare setting. Am J Manag Care. 2005;11:774-780.
Hawkins EJ, Lambert MJ, Vermeersch DA, Slade K, Tuttle KC. The therapeutic effects of providing patient progress information to therapists and patients. Psychother Res. 2004;14:308-327.
Whipple JL, Lambert MJ, Vermeersch DA, Smart DW, Nielsen SL, Hawkins EJ. Improving the effects of psychotherapy: the use of early identification of treatment and problem-solving strategies in routine practice. J Couns Psychol. 2003;50:59-68.
Lambert MJ, Whipple JL, Vermeersch DA, et al. Enhancing psychotherapy outcomes via providing feedback on client progress: a replication. Clin Psychol Psychother. 2002;9:91-103.
Boswell J, Constantine M, Kraus D, Bugatti M, Oswald J. The expanding relevance of routinely collected outcome data for mental health care decision making. Adm Policy Ment Health. 2015;43(4):482-491.
The Joint Commission. (2018, July 15). New Outcome Measures Standard. CTS.03.01.09. https://www.jointcommission.org/accreditation/bhc_new_outcome_measures. Accessed March 26, 2020.
Burgess P, Coombs T, Clarke A, Dickson R, Pirkis J. Achievements in mental health outcome measurement in Australia: reflections on progress made by the Australian Mental Health Outcomes and Classification Network (AMHOCN). Int J Ment Health Syst. 2012;6:4.
Pincus HA, Spaeth-Rublee B, Watkins KE. The case for measuring quality in mental health and substance abuse care. Health Aff. 2011;30:730-736.
Zimmerman M, McGlinchey JB. Why don't psychiatrists use scales to measure outcome when treating depressed patients? J Clin Psychiatry. 2008;69:1916-1919.
Goldman HH, Seybolt DC. What can we learn from the ongoing challenge to implement routine outcome measures? Int Rev Psychiatry. 2015;27(4):261-263.
Hatfield DR, Ogles BM. The use of outcome measures by psychologists in clinical practice. Prof Psychol Res Pract. 2004;35:85-491.
Gilbody SM, House AO, Sheldon TA. Psychiatrists in the UK do not use outcome measures. Br J Psychiatry. 2002;18:101-103.
Oslin DW, Hoff R, Mignogna J, Resnick SG. Provider attitudes and experience with measurement-based mental health care in the VA Implementation Project. Psychiatr Serv. 2019;70(2):135-138.
Jensen-Doss A, Haimes EMB, Smith AM, et al. Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Adm Policy Ment Health. 2018;45(1):48-61.
Walfish S, McAlister B, O'Donnell P, Lambert MJ. An investigation of self-assessment bias in mental health providers. Psychol Rep. 2012;110:639-644.
Garb HN. Clinical judgment and decision making. Annu Rev Clin Psychol. 2005;1:67-89.
Hannan C, Lambert MJ, Harmon C, Nielson SL, Shimokawa K, Sutton SW. A lab test and algorithms for identifying clients at risk for treatment failure. J Clin Psychol. 2005;61:155-163.
Lewis CC, Boyd M, Puspitasari A, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiat. 2019;76(3):324-335.
Callaly T, Hyland M, Coombs T. Routine outcome measurement in public mental health: results of a clinician survey. Aust Health Rev. 2006;30:164-173.
Trauer T, Gill L, Pedwell G, Slattery P. Routine outcome measurement in public mental health-what do clinicians think? Aust Health Rev. 2006;30:144-147.
Aoun S, Pennebaker D, Janca A. Outcome measurement in rural mental health: a field trial of rooming-in models. Aust J Rural Health. 2002;10:302-307.
Meehan T, McCombs S, Hatzipetrou S, Catchpoole R. Introduction of routine outcome measures: staff reactions and issues for consideration. J Psychiatr Ment Health Nurs. 2006;13:582-587.
Garland AF, Kruse M, Aarons GA. Clinicians and outcome measurement: what's the use? J Behav Health Serv Res. 2003;30:393-405.
Walter G, Cleary M, Rey JM. Attitudes of mental health personnel towards rating outcome. J Qual Clin Pract. 1998;18:109-115.
Svirydzenka N, Ronzoni P, Dogra N. Meaning and barriers to quality care service provision in child and adolescent mental health services: qualitative study of stakeholder perspectives. BMC Health Serv Res. 2017;17(1):151.
Patterson P, Matthey S, Baker M. Using mental health outcome measures in everyday clinical practice. Australas Psychiatry. 2006;14:133-136.
Pirkis J, Burgess P, Coombs T, Clarke A, Jones-Ellis D, Dickson R. Routine measurement of outcomes in Australia's public sector mental health services. Aust New Zealand Health Policy. 2005;2:8.
Sharples E, Qin C, Goveas V, Gondek D, Deighton J, Wolpert M. Edbrooke-Childs. A qualitative exploration of attitudes towards the use of outcome measures in child and adolescent mental health services. Clin Child Psychol Psychiatry. 2017;22(2):219-228.
Charmaz C. Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. London, England: Sage Publications; 1996.
Krishna R, Valleru J, Smith W. Implementing outcome-based care in pediatric psychiatry: early results and overcoming barriers. Pediatr Qual Saf. 2019;4(1):e132.
Bitan DT, Ganor O, Biran L, Bloch Y. Implementing routine outcome monitoring in public mental health services in Israel: shared and unique challenges. J Eval Clin Pract. 2018;24(2):323-330.
Bickman L, Douglas SR, De Andrade ARV, et al. Implementing a measurement feedback system: a tale of two sites. Adm Policy Ment Health. 2014;43(3):410-425.
Amble I, Gude T, Ulvenes P, Stubdal S, Wampold BE. How and when feedback works in psychotherapy: is it the signal? Psychother Res. 2015;26:545-555.
Kahneman D, Knetsch JL, Thaler RH. Anomalies: the endowment effect, loss aversion, and status quo bias. J Econ Perspect. 1991;5:193-206.
Kahneman D, Slovic P, Tversky A. Judgment under Uncertainty: Heuristics and Biases. Cambridge, UK: Cambridge University Press; 1982.
Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. 2005;19(5):531-540.