Comparing organization-focused and state-focused financing strategies on provider-level reach of a youth substance use treatment model: a mixed-method study.
A-CRA
Behavioral health service systems
Evidence-based practices
Financing strategies
Implementation
Policy
Public finance
Reach
Substance use disorder treatment
Youth substance use
Journal
Implementation science : IS
ISSN: 1748-5908
Titre abrégé: Implement Sci
Pays: England
ID NLM: 101258411
Informations de publication
Date de publication:
12 10 2023
12 10 2023
Historique:
received:
05
05
2023
accepted:
18
09
2023
medline:
1
11
2023
pubmed:
13
10
2023
entrez:
12
10
2023
Statut:
epublish
Résumé
Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes. A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach. The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities). As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.
Sections du résumé
BACKGROUND
Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes.
METHOD
A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach.
RESULTS
The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities).
DISCUSSION
As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.
Identifiants
pubmed: 37828518
doi: 10.1186/s13012-023-01305-z
pii: 10.1186/s13012-023-01305-z
pmc: PMC10571404
doi:
Types de publication
Journal Article
Research Support, U.S. Gov't, P.H.S.
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
50Subventions
Organisme : NIDA NIH HHS
ID : R01DA051545
Pays : United States
Organisme : AHRQ HHS
ID : T32 HS000046
Pays : United States
Organisme : NIDA NIH HHS
ID : R01 DA049891
Pays : United States
Organisme : NIAAA NIH HHS
ID : R01 AA021217
Pays : United States
Informations de copyright
© 2023. BioMed Central Ltd., part of Springer Nature.
Références
Hogue A, Henderson CE, Becker SJ, Knight DK. Evidence base on outpatient behavioral treatments for adolescent substance use, 2014–2017: outcomes, treatment delivery, and promising horizons. J Clin Child Adolesc Psychol. 2018. https://doi.org/10.1080/15374416.2018.1466307 .
doi: 10.1080/15374416.2018.1466307
pubmed: 29893607
pmcid: 7192024
Godley SH, Smith JE, Meyers RJ, Godley MD. The adolescent community reinforcement approach: a clinical guide for treating substance use disorders. Normal, IL: Chestnut Health Systems; 2016. https://www.amazon.com/Adolescent-Community-Reinforcement-Approach-Substance/dp/0998058009 . Accessed 27 Sept 2023.
Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: results from the 2020 National Survey on Drug Use and Health (HHS publication no. PEP21-07-01-003, NSDUH series H-56). Rockville, MD: Substance Abuse and Mental Health Services Administration; 2021.
Bruns EJ, Kerns SE, Pullmann MD, Hensley SW, Lutterman T, Hoagwood KE. Research, data, and evidence-based treatment use in state behavioral health systems, 2001–2012. Psychiatr Serv. 2016. https://doi.org/10.1176/appi.ps.201500014 .
doi: 10.1176/appi.ps.201500014
pubmed: 26695495
Garner BR. Research on the diffusion of evidence-based treatments within substance abuse treatment: a systematic review. J Subst Abuse Treat. 2009. https://doi.org/10.1016/j.jsat.2008.08.004 .
doi: 10.1016/j.jsat.2008.08.004
pubmed: 19553067
pmcid: 2789887
Gotham HJ. Research to practice in addiction treatment: key terms and a field-driven model of technology transfer. J Subst Abuse Treat. 2011. https://doi.org/10.1016/j.jsat.2011.02.006 .
doi: 10.1016/j.jsat.2011.02.006
McCarty D, McConnell KJ, Schmidt LA. Priorities for policy research on treatments for alcohol and drug use disorders. J Subst Abuse Treat. 2010. https://doi.org/10.1016/j.jsat.2010.05.003 .
doi: 10.1016/j.jsat.2010.05.003
pubmed: 20659649
pmcid: 2913125
Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implement Sci. 2017. https://doi.org/10.1186/s13012-017-0657-x .
doi: 10.1186/s13012-017-0657-x
pubmed: 29100551
pmcid: 5670723
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015. https://doi.org/10.1186/s13012-015-0209-1 .
doi: 10.1186/s13012-015-0209-1
pubmed: 26566623
pmcid: 4644277
Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013. https://doi.org/10.1186/1748-5908-8-139 .
doi: 10.1186/1748-5908-8-139
pubmed: 24289295
pmcid: 3882890
Dopp AR, Narcisse M-R, Mundey P. A scoping review of strategies for financing the implementation of evidence-based practices in behavioral health systems: state of the literature and future directions. Implement Res Prac. 2020. https://doi.org/10.1177/2633489520939980 .
doi: 10.1177/2633489520939980
Bond GR, Drake RE, McHugo GJ, Peterson AE, Jones AM, Williams J. Long-term sustainability of evidence-based practices in community mental health agencies. Adm Policy Ment Health. 2014. https://doi.org/10.1007/s10488-012-0461-5 .
doi: 10.1007/s10488-012-0461-5
pubmed: 23266661
Jaramillo ET, Willging CE, Green AE, Gunderson LM, Fettes DL, Aarons GA. “Creative financing”: funding evidence-based interventions in human service systems. J Behav Health Serv Res. 2019. https://doi.org/10.1007/s11414-018-96445 .
doi: 10.1007/s11414-018-96445
pubmed: 30535899
pmcid: 6816239
Lang JM, Connell CM. Measuring costs to community-based agencies for implementation of an evidence-based practice. J Behav Health Serv Res. 2017. https://doi.org/10.1007/s11414-016-9541-8 .
doi: 10.1007/s11414-016-9541-8
pubmed: 27804099
Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008. https://doi.org/10.1186/1748-5908-3-26 .
doi: 10.1186/1748-5908-3-26
pubmed: 18485219
pmcid: 2396668
Roundfield KD, Lang JM. Costs to community mental health agencies to sustain an evidence-based practice. Psychiatr Serv. 2017. https://doi.org/10.1176/appi.ps.201600193 .
doi: 10.1176/appi.ps.201600193
pubmed: 28457214
Hunter SB, Felician M, Dopp AR, Godley SH, Pham C, Bouskill K, et al. What influences evidence-based treatment sustainment after implementation support ends? a mixed method study of the adolescent-community reinforcement approach. J Subst Abuse Treat. 2020. https://doi.org/10.1016/j.jsat.2020.107999 .
doi: 10.1016/j.jsat.2020.107999
pubmed: 32359672
pmcid: 7202398
Hunter SB, Han B, Slaughter ME, Godley SH, Garner BR. Associations between implementation characteristics and evidence-based practice sustainment: a study of the adolescent community reinforcement approach. Implement Sci. 2015. https://doi.org/10.1186/s13012-015-0364-4 .
doi: 10.1186/s13012-015-0364-4
pubmed: 26701601
pmcid: 4690218
Hunter SB, Han B, Slaughter ME, Godley SH, Garner BR. Predicting evidence-based treatment sustainment: results from a longitudinal study of the adolescent-community reinforcement approach. Implement Sci. 2017. https://doi.org/10.1186/s13012-017-0606-8 .
doi: 10.1186/s13012-017-0606-8
pubmed: 28610574
pmcid: 5470280
Brown BS, Flynn PM. The federal role in drug abuse technology transfer: a history and perspective. J Subst Abuse Treat. 2002. https://doi.org/10.1016/S0740-5472(02)00228-3 .
doi: 10.1016/S0740-5472(02)00228-3
pubmed: 12220611
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011. https://doi.org/10.1007/s10488-010-0319-7 .
doi: 10.1007/s10488-010-0319-7
Proctor EK, Bunger AC, Lengnick-Hall R, Gerke DR, Martin JK, Phillips RJ, et al. Ten years of implementation outcomes research: a scoping review. Implement Sci. 2023. https://doi.org/10.1186/s13012-023-01286-z .
doi: 10.1186/s13012-023-01286-z
pubmed: 37904218
pmcid: 10492269
Reilly KL, Kennedy S, Porter G, Estabrooks P. Comparing, contrasting, and integrating dissemination and implementation outcomes included in the RE-AIM and implementation outcomes frameworks. Front Public Health. 2020;8:430.
doi: 10.3389/fpubh.2020.00430
pubmed: 32984239
pmcid: 7492593
Pinnock H, Barwick MA, Carpenter C, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017. https://doi.org/10.1136/bmj.i6795 .
doi: 10.1136/bmj.i6795
pubmed: 28264797
pmcid: 5421438
Dopp AR, Hunter SB, Godley MD, Pham C, Han B, Smart R, et al. Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study. Implementation Science Communications. 2022. https://doi.org/10.1186/s43058-022-00298-y .
doi: 10.1186/s43058-022-00298-y
pubmed: 35562836
pmcid: 9099033
Hunter SB, Ayer L, Han B, Garner BR, Godley SH. Examining the sustainment of the adolescent-community reinforcement approach in community addiction treatment settings: protocol for a longitudinal mixed method study. Implement Sci. 2014. https://doi.org/10.1186/s13012-014-0104-1 .
doi: 10.1186/s13012-014-0104-1
pubmed: 25164125
pmcid: 4164760
Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011. https://doi.org/10.1007/s10488-010-0314-z .
doi: 10.1007/s10488-010-0314-z
pubmed: 20967495
pmcid: 3050572
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Heal Ment Heal Serv Res. 2011. https://doi.org/10.1007/s10488-010-0327-7 .
doi: 10.1007/s10488-010-0327-7
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019. https://doi.org/10.1186/s13012-0180842-6 .
doi: 10.1186/s13012-0180842-6
pubmed: 30611302
pmcid: 6321673
Stewart RE, Adams DR, Mandell DS, Hadley TR, Evans AC, Rubin R, et al. The perfect storm: collision of the business of mental health and the implementation of evidence-based practices. Psychiatr Serv. 2016;67(2):159–61.
doi: 10.1176/appi.ps.201500392
pubmed: 26522680
Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012. https://doi.org/10.1016/j.jaac.2012.01.018 .
doi: 10.1016/j.jaac.2012.01.018
pubmed: 22449648
pmcid: 3841107
Michaelis B, Stegmaier R, Sonntag K. Shedding light on followers’ innovation implementation behavior: the role of transformational leadership, commitment to change, and climate for initiative. J Manag Psychol. 2010. https://doi.org/10.1108/02683941011035304 .
doi: 10.1108/02683941011035304
Substance Abuse and Mental Health Services Administration. Center for Substance Abuse Treatment. 2021. https://www.samhsa.gov/about-us/who-we-are/offices-centers/csat . Accessed 27 Sept 2023.
Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clin Psychol Sci Pr. 2011. https://doi.org/10.1111/j.1468-2850.2011.01236.x .
doi: 10.1111/j.1468-2850.2011.01236.x
Calhoun A, Mainor A, Moreland-Russell S, Maier RC, Brossart L, Luke DA. Using the program sustainability assessment tool to assess and plan for sustainability. Prev Chronic Dis. 2014. https://doi.org/10.5888/pcd11.130185 .
doi: 10.5888/pcd11.130185
pubmed: 24456645
pmcid: 3900327
Center for Public Health System Science. Program sustainability assessment tool. 2012. https://www.sustaintool.org/psat/ . Accessed 27 Sept 2023.
Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks, CA: Sage Publications; 2002.
Garner BR, Hunter SB, Slaughter ME, Han B, Godley SH. Factors associated with an evidence-based measure of implementation for the adolescent community reinforcement approach. Drug Alcohol Depend. 2017. https://doi.org/10.1016/j.drugalcdep.2017.08.011 .
doi: 10.1016/j.drugalcdep.2017.08.011
pubmed: 28888154
pmcid: 6757189
Godley MD, Passetti LL, Subramaniam GA, Funk RR, Smith JE, Meyers RJ. Adolescent community reinforcement approach implementation and treatment outcomes for youth with opioid problem use. Drug Alcohol Depend. 2017. https://doi.org/10.1016/j.drugalcdep.2016.12.029 .
doi: 10.1016/j.drugalcdep.2016.12.029
pmcid: 6757189
Campos-Melady M, Smith JE, Meyers RJ, Godley SH, Godley MD. The effect of therapists’ adherence and competence in delivering the adolescent community reinforcement approach on client outcomes. Psychol Addict Behav. 2017. https://doi.org/10.1037/adb0000216 .
doi: 10.1037/adb0000216
pubmed: 27736146
Curtis SV, Wodarski JS. The East Tennessee assertive adolescent family treatment program: a three-year evaluation. Soc Work Public Health. 2015. https://doi.org/10.1080/19371918.2014.992713 .
doi: 10.1080/19371918.2014.992713
pubmed: 25757693
Garner BR, Hunter SB, Funk RR, Griffin BA, Godley SH. Toward evidence-based measures of implementation: examining the relationship between implementation outcomes and client outcomes. J Subst Abuse Treat. 2016. https://doi.org/10.1016/j.jsat.2016.04.006 .
doi: 10.1016/j.jsat.2016.04.006
pubmed: 27296657
pmcid: 5033242
Strunz E, Jungerman J, Kinyua J, Frew PM. Evaluation of an assertive continuing care program for Hispanic adolescents. Glob J Health Sci. 2015. https://doi.org/10.5539/gjhs.v7n5p106 .
doi: 10.5539/gjhs.v7n5p106
pubmed: 26156933
pmcid: 4803868
Coryn CL, Hobson KA. Using nonequivalent dependent variables to reduce internal validity threats in quasi-experiments: rationale, history, and examples from practice. New Dir Eval. 2011. https://doi.org/10.1002/ev.375 .
doi: 10.1002/ev.375
Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin; 2002.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005. https://doi.org/10.1177/1049732305276687 .
doi: 10.1177/1049732305276687
pubmed: 16204405
Ryan GW, Bernard HR. Techniques to identify themes. Field Methods. 2003. https://doi.org/10.1177/1525822X02239569 .
doi: 10.1177/1525822X02239569
Bartlett L, Vavrus F. Comparative case studies: an innovative approach. Nord J Comp Int Educ. 2017. https://doi.org/10.7577/njcie.1929 .
doi: 10.7577/njcie.1929
Yin RK. Case study research design and methods. 4th ed. Thousand Oaks, CA: Sage Publications; 2009.
Purtle J, Wynecoop M, Crane ME, Stadnick NA. Earmarked taxes for mental health services in the United States: a local and state legal mapping study. Milbank Q. 2023. https://doi.org/10.1111/1468-0009.12643 .
doi: 10.1111/1468-0009.12643
pubmed: 37070393
Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. Front Public Health. 2020;8:134.
doi: 10.3389/fpubh.2020.00134
pubmed: 32478025
pmcid: 7235159
Nathan N, Powell BJ, Shelton RC, Laur CV, Wolfenden L, Hailemariam M, et al. Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment? Front Health Serv. 2022;2:905909.
doi: 10.3389/frhs.2022.905909
pubmed: 36925827
pmcid: 10012683
Aarons GA, Green AE, Willging CE, Ehrhart MG, Roesch SC, Hecht DB, et al. Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implement Sci. 2014. https://doi.org/10.1186/s13012-014-0183-z .
doi: 10.1186/s13012-014-0183-z
pubmed: 25490886
pmcid: 4272775
Hartzler B, Jackson TR, Jones BE, Beadnell B, Calsyn DA. Disseminating contingency management: impacts of staff training and implementation at an opiate treatment program. J Subst Abuse Treat. 2014. https://doi.org/10.1016/j.jsat.2013.12.007 .
doi: 10.1016/j.jsat.2013.12.007
pubmed: 24462242
Hunter SB, Ober AJ, McCullough CM, Storholm ED, Iyiewuare PO, Pham C, et al. Sustaining alcohol and opioid use disorder treatment in primary care: a mixed methods study. Implement Sci. 2018. https://doi.org/10.1186/s13012-018-0777-y .
doi: 10.1186/s13012-018-0777-y
pubmed: 30126437
pmcid: 6102816
Dakof GA, Ricardo MM, Rowe C, Henderson C, Rigter H, Liddle HA. Sustainment rates and factors for multidimensional family therapy in Europe and North America. Global Implementation Research and Applications. 2022. https://doi.org/10.1007/s43477-022-00043-6 .
doi: 10.1007/s43477-022-00043-6
Scudder AT, Taber-Thomas SM, Schaffner K, Pemberton JR, Hunter L, Herschell AD. A mixed-methods study of system-level sustainability of evidence-based practices in 12 large-scale implementation initiatives. Health Res Policy Syst. 2017. https://doi.org/10.1186/s12961-017-0230-8 .
doi: 10.1186/s12961-017-0230-8
pubmed: 29216886
pmcid: 5721589
Brookman-Frazee L, Stadnick N, Roesch S, Regan J, Barnett M, Bando L, et al. Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Adm Policy Ment Heal Ment Heal Serv Res. 2016. https://doi.org/10.1007/s10488-016-0731-8 .
doi: 10.1007/s10488-016-0731-8
Brookman-Frazee L, Zhan C, Stadnick N, Sommerfeld D, Roesch S, Aarons GA, et al. Using survival analysis to understand patterns of sustainment within a system-driven implementation of multiple evidence-based practices for children’s mental health services. Front Public Health. 2018;6:54.
doi: 10.3389/fpubh.2018.00054
pubmed: 29546038
pmcid: 5839095
Crable EL, Lengnick-Hall R, Stadnick NA, Moullin JC, Aarons GA. Where is “policy” in dissemination and implementation science? recommendations to advance theories, models, and frameworks: EPIS as a case example. Implement Sci. 2022. https://doi.org/10.1186/s13012-022-01256-x .
doi: 10.1186/s13012-022-01256-x
pubmed: 36503520
pmcid: 9742035
Lengnick-Hall R, Stadnick NA, Dickson KS, Moullin JC, Aarons GA. Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment. Implement Sci. 2021. https://doi.org/10.1186/s13012-021-01099-y .
doi: 10.1186/s13012-021-01099-y
pubmed: 33794956
pmcid: 8015179
Lengnick-Hall R, Willging C, Hurlburt M, Fenwick K, Aarons GA. Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple US public sector service systems. Implement Sci. 2020. https://doi.org/10.1186/s13012-020-00999-9 .
doi: 10.1186/s13012-020-00999-9
pubmed: 32912237
pmcid: 7488112
Becker-Haimes EM, Marcus SC, Klein MR, Schoenwald SK, Fugo PB, McLeod BD, et al. A randomized trial to identify accurate measurement methods for adherence to cognitive-behavioral therapy. Behav Ther. 2022. https://doi.org/10.1016/j.beth.2022.06.001 .
doi: 10.1016/j.beth.2022.06.001
pubmed: 36229116
pmcid: 9680992
Hooley C, Salvo D, Brown DS, Brookman-Frazee L, Lau AS, Brownson RC, et al. Scaling-up child and youth mental health services: assessing coverage of a county-wide prevention and early intervention initiative during one fiscal year. Adm Policy Ment Heal Ment Heal Serv Res. 2023. https://doi.org/10.1007/s10488-022-01220-3 .
doi: 10.1007/s10488-022-01220-3