Scaling Interventions to Manage Chronic Disease: Innovative Methods at the Intersection of Health Policy Research and Implementation Science.
Implementation
Policy
Scale-up
Journal
Prevention science : the official journal of the Society for Prevention Research
ISSN: 1573-6695
Titre abrégé: Prev Sci
Pays: United States
ID NLM: 100894724
Informations de publication
Date de publication:
01 Sep 2022
01 Sep 2022
Historique:
accepted:
16
08
2022
pubmed:
2
9
2022
medline:
2
9
2022
entrez:
1
9
2022
Statut:
aheadofprint
Résumé
Policy implementation is a key component of scaling effective chronic disease prevention and management interventions. Policy can support scale-up by mandating or incentivizing intervention adoption, but enacting a policy is only the first step. Fully implementing a policy designed to facilitate implementation of health interventions often requires a range of accompanying implementation structures, like health IT systems, and implementation strategies, like training. Decision makers need to know what policies can support intervention adoption and how to implement those policies, but to date research on policy implementation is limited and innovative methodological approaches are needed. In December 2021, the Johns Hopkins ALACRITY Center for Health and Longevity in Mental Illness and the Johns Hopkins Center for Mental Health and Addiction Policy convened a forum of research experts to discuss approaches for studying policy implementation. In this report, we summarize the ideas that came out of the forum. First, we describe a motivating example focused on an Affordable Care Act Medicaid health home waiver policy used by some US states to support scale-up of an evidence-based integrated care model shown in clinical trials to improve cardiovascular care for people with serious mental illness. Second, we define key policy implementation components including structures, strategies, and outcomes. Third, we provide an overview of descriptive, predictive and associational, and causal approaches that can be used to study policy implementation. We conclude with discussion of priorities for methodological innovations in policy implementation research, with three key areas identified by forum experts: effect modification methods for making causal inferences about how policies' effects on outcomes vary based on implementation structures/strategies; causal mediation approaches for studying policy implementation mechanisms; and characterizing uncertainty in systems science models. We conclude with discussion of overarching methods considerations for studying policy implementation, including measurement of policy implementation, strategies for studying the role of context in policy implementation, and the importance of considering when establishing causality is the goal of policy implementation research.
Identifiants
pubmed: 36048400
doi: 10.1007/s11121-022-01427-8
pii: 10.1007/s11121-022-01427-8
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : NIMH NIH HHS
ID : R21 MH125261
Pays : United States
Commentaires et corrections
Type : ErratumIn
Informations de copyright
© 2023. The Author(s) 2023.
Références
Alegria, M. (2022). Opening the black box: overcoming obstacles to studying causal mechanisms in research on reducing inequality. William T. Grant Foundation. http://wtgrantfoundation.org/library/uploads/2022/03/Alegria-Omalley_WTG-Digest-7.pdf .
Baicker, K., Taubman, S. L., Allen, H. L., Bernstein, M., Gruber, J. H., Newhouse, J. P., Schneider, E. C., Wright, B. J., Zaslavsky, A. M., & Finkelstein, A. N. (2013). The Oregon experiment - effects of Medicaid on clinical outcomes. New England Journal of Medicine, 368, 1713–1722.
pubmed: 23635051
doi: 10.1056/NEJMsa1212321
Bandara, S. N., Kennedy-Hendricks, A., Stuart, E. A., Barry, C. L., Abrams, M. T., Daumit, G. L., & McGinty, E. E. (2019). The effects of the Maryland Medicaid Health Home Waiver on Emergency Department and inpatient utilization among individuals with serious mental illness. General Hospital Psychiatry.
Ben-Michael, E., Feller, A., & Rothstein, J. (2018). The augmented synthetic control method. Working paper. arxiv:1811.0v1 .
Ben-Michael, E., Feller, A., & Rothstein, J. (2021). The Augmented Synthetic Control Method. Journal of the American Statistical Association, 116, 1789–1803.
doi: 10.1080/01621459.2021.1929245
Bullock, H. L., Lavis, J. N., Wilson, M. G., Mulvale, G., & Miatello, A. (2021). Understanding the implementation of evidence-informed policies and practices from a policy perspective: A critical interpretive synthesis. Implementation Science, 16, 1–24.
doi: 10.1186/s13012-021-01082-7
Calhoun, A., Hovmand, P., Andersen, D., Richardson, G., Hower, T., & Rouwette, E. A. J. A. (2010). Scriptapedia: A digital commons for documenting and sharing group model building scripts.
Callaway, B., Pedro, H. C., & Sant’Anna. (2021). Difference-in-differences with multiple time periods. Journal of Econometrics, 225, 200–230.
doi: 10.1016/j.jeconom.2020.12.001
Centers for Medicare and Medicaid Services. (2020). Health Home Information Resource Center. https://www.medicaid.gov/state-resource-center/medicaid-state-technical-assistance/health-homes-technical-assistance/health-home-information-resource-center.html . Accessed 28 Feb 2020.
Cerdá, M., Ponicki, W., Smith, N., Rivera-Aguirre, A., Davis, C. S., Marshall, B. D., et al. (2020). Measuring relationships between proactive reporting state-level prescription drug monitoring programs and county-level fatal prescription opioid overdoses. Epidemiology (Cambridge, Mass.), 31, 32–42.
D’Agostino McGowan, L., Grantz, K. H., & Murray, E. (2021). Quantifying uncertainty in mechanistic models of infectious disease. American Journal of Epidemiology, 190, 1377–1385.
doi: 10.1093/aje/kwab013
Daumit, G. L., Stone, E. M., Kennedy-Hendricks, A., Choksy, S., Marsteller, J. A., & McGinty, E. E. (2019). Care coordination and population health management strategies and challenges in a behavioral health home model. Medical Care, 57, 79–84.
pubmed: 30439791
pmcid: 6289741
doi: 10.1097/MLR.0000000000001023
Druss, B. G., von Esenwein, S. A., Compton, M. T., Rask, K. J., Zhao, L., & Parker, R. M. (2010). A randomized trial of medical care management for community mental health settings: The Primary Care Access, Referral, and Evaluation (PCARE) study. American Journal of Psychiatry, 167, 151–159.
pubmed: 20008945
doi: 10.1176/appi.ajp.2009.09050691
Druss, B. G., von Esenwein, S. A., Glick, G. E., Deubler, E., Lally, C., Ward, M. C., & Rask, K. J. (2017). Randomized trial of an integrated behavioral health home: the Health Outcomes Management and Evaluation (HOME) Study. American Journal of Psychiatry, 174, 246–255.
pubmed: 27631964
doi: 10.1176/appi.ajp.2016.16050507
Emmons, K. M., & Chambers, D. A. (2021). Policy implementation science - an unexplored strategy to address social determinants of health. Ethnicity & Disease, 31, 133.
doi: 10.18865/ed.31.1.133
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531–540.
doi: 10.1177/1049731509335549
Gates, M. (2017). Machine learning: for beginners-definitive guide for neural networks, algorithms, random forests and decision trees made simple (Machine Learning Series Book).
Haroz, E. E., Fine, S. L., Lee, C., Wang, Qi., Hudhud, M., & Igusa, T. (2021). Planning for suicide prevention in Thai refugee camps: Using community-based system dynamics modeling. Asian American Journal of Psychology, 12, 193.
pubmed: 35251488
pmcid: 8890690
doi: 10.1037/aap0000190
Hernán, M. A., & Robins, J. M. (2006). Instruments for causal inference: an epidemiologist's dream? Epidemiology, 360–72.
Hoagwood, K. E., Purtle, J., Spandorfer, J., Peth-Pierce, R., & Horwitz, S. M. (2020). Aligning dissemination and implementation science with health policies to improve children’s mental health. American Psychologist, 75, 1130.
pubmed: 33252950
doi: 10.1037/amp0000706
Hovmand, P. S. (2014). Group model building and community-based system dynamics process. In Community based system dynamics (Springer).
Huang, W., Chang, C. H., Stuart, E. A., Daumit, G. L., Wang, N. Y., McGinty, E. E., et al. (2021). Agent-based modeling for implementation research: An application to tobacco smoking cessation for persons with serious mental illness. In Implementation Science Communications, 2, 1–16.
Janssen, E. M., McGinty, E. E., Azrin, S. T., Juliano-Bult, D., & Daumit, G. L. (2015). Review of the evidence: Prevalence of medical conditions in the United States population with serious mental illness. General Hospital Psychiatry, 37, 199–222.
pubmed: 25881768
pmcid: 4663043
doi: 10.1016/j.genhosppsych.2015.03.004
Kennedy-Hendricks, A., Daumit, G. L., Choksy, S., Linden, S., & McGinty, E. E. (2018). Measuring variation across dimensions of integrated care: the maryland medicaid health home model. Administration and Policy in Mental Health and Mental Health Services Research, 1–12.
Keyes, K. M., Shev, A., Tracy, M., & Cerdá, M. (2019). Assessing the impact of alcohol taxation on rates of violent victimization in a large urban area: An agent-based modeling approach. Addiction, 114, 236–247.
pubmed: 30315599
doi: 10.1111/add.14470
Kilbourne, A. M., Abraham, K. M., Goodrich, D. E., Bowersox, N. W., Almirall, D., Lai, Z., & Nord, K. M. (2013). Cluster randomized adaptive implementation trial comparing a standard versus enhanced implementation intervention to improve uptake of an effective re-engagement program for patients with serious mental illness. Implementation Science, 8, 1–14.
doi: 10.1186/1748-5908-8-136
Kilbourne, A. M., Almirall, D., Eisenberg, D., Waxmonsky, J., Goodrich, D. E., Fortney, J. C., Kirchner, J. E., Solberg, L. I., Main, D., & Bauer, M. S. (2014). Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): Cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implementation Science, 9, 1–14.
doi: 10.1186/s13012-014-0132-x
Kontopantelis, E., Doran, T., Springate, D. A., Buchan, I., & Reeves, D. (2015). Regression based quasi-experimental approach when randomisation is not an option: interrupted time series analysis. BMJ, 350.
Langellier, B. A., Yang, Y., Purtle, J., Nelson, K. L., Stankov, I., Diez, A. V., & Roux. (2019). Complex systems approaches to understand drivers of mental health and inform mental health policy: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research, 46, 128–144.
pubmed: 29995289
doi: 10.1007/s10488-018-0887-5
Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017). Beyond “implementation strategies”: Classifying the full range of strategies used in implementation science and practice. Implementation Science, 12, 1–9.
doi: 10.1186/s13012-017-0657-x
Linden, A., Adams, J. L., & Roberts, N. (2003). Evaluating disease management program effectiveness: An introduction to time-series analysis. Disease Management, 6, 243–255.
pubmed: 14736348
doi: 10.1089/109350703322682559
Links, J. M., Schwartz, B. S., Lin, S., Kanarek, N., Mitrani-Reiser, J., Sell, T. K., Watson, C. R., Ward, D., Slemp, C., & Burhans, R. (2018). COPEWELL: A conceptual framework and system dynamics model for predicting community functioning and resilience after disasters. Disaster Medicine and Public Health Preparedness, 12, 127–137.
pubmed: 28633681
doi: 10.1017/dmp.2017.39
Ludwig, J., Liebman, J. B., Kling, J. R., Duncan, G. J., Katz, L. F., Kessler, R. C., & Sanbonmatsu, L. (2008). What can we learn about neighborhood effects from the moving to opportunity experiment? American Journal of Sociology, 114, 144–188.
doi: 10.1086/588741
Martins, S. S., Bruzelius, E., Stingone, J. A., Wheeler-Martin, K., Akbarnejad, H., Mauro, C. M., Marziali, M. E., Samples, H., Crystal, S., & Davis, C. S. (2021). Prescription opioid laws and opioid dispensing in US counties: Identifying salient law provisions with machine learning. Epidemiology, 32, 868–876.
pubmed: 34310445
pmcid: 8556655
doi: 10.1097/EDE.0000000000001404
Martins, S. S., Ponicki, W., Smith, N., Rivera-Aguirre, A., Davis, C. S., Fink, D. S., Castillo-Carniglia, A., Henry, S. G., Marshall, B. D. L., & Gruenewald, P. (2019). Prescription drug monitoring programs operational characteristics and fatal heroin poisoning. International Journal of Drug Policy, 74, 174–180.
pubmed: 31627159
doi: 10.1016/j.drugpo.2019.10.001
McClellan, C., Maclean, J. C., Saloner, B., McGinty, E. E., & Pesko, M. F. (2020). Integrated care models and behavioral health care utilization: Quasi-experimental evidence from Medicaid health homes. Health Economics, 29, 1086–1097.
pubmed: 32323396
pmcid: 7863583
doi: 10.1002/hec.4027
McGinty, E. E., Stone, E. M., Kennedy-Hendricks, A., Bandara, S., Murphy, K. A., Stuart, E. A., Rosenblum, M. A., & Daumit, G. L. (2019). Effects of Maryland’s Affordable Care Act Medicaid Health Home Waiver on Quality of Cardiovascular Care among People with Serious Mental Illness. In Press.
McGinty, E. E., Kennedy-Hendricks, A., Linden, S., Choksy, S., Stone, E., & Daumit, G. L. (2018). An innovative model to coordinate healthcare and social services for people with serious mental illness: A mixed-methods case study of Maryland’s Medicaid health home program. General Hospital Psychiatry, 51, 54–62.
pubmed: 29316451
doi: 10.1016/j.genhosppsych.2017.12.003
McGinty, E. E., Baller, J., Azrin, S. T., Juliano-Bult, D., & Daumit, G. L. (2015). Quality of medical care for persons with serious mental illness: A comprehensive review. Schizophrenia Research, 165, 227–235.
pubmed: 25936686
doi: 10.1016/j.schres.2015.04.010
Meter, V., Donald, S., & Van Horn, C. E. (1975). The policy implementation process: A conceptual framework. Administration & Society, 6, 445–488.
doi: 10.1177/009539977500600404
Moodie, E. E. M., Chakraborty, B., & Kramer, M. S. (2012). Q-learning for estimating optimal dynamic treatment rules from observational data. Canadian Journal of Statistics, 40, 629–645.
doi: 10.1002/cjs.11162
Murphy, K. A., Daumit, G. L., Bandara, S. N., Stone, E. M., Kennedy-Hendricks, A., Stuart, E. A., & McGinty, E. E. (2019). Medicaid Health Homes' impact on readmissions and follow-up after hospitalization. Under Review.
Murphy, K. A., Daumit, G. L., Stone, E. M., & McGinty, E. E. (2019). Physical Health Outcomes and Implementation of Behavioral Health Homes: A Comprehensive Review. In Press.
Murphy, S. A. (2005). An experimental design for the development of adaptive treatment strategies. Statistics in Medicine, 24, 1455–1481.
pubmed: 15586395
doi: 10.1002/sim.2022
Nguyen, T. Q., Schmid, I., & Stuart, E. A. (2021). Clarifying causal mediation analysis for the applied researcher: Defining effects based on what we want to learn. Psychological Methods, 26, 255.
doi: 10.1037/met0000299
Olfson, M., Gerhard, T., Huang, C., Crystal, S., & Stroup, TS. (2015). Premature mortality among adults with schizophrenia in the United States. JAMA Psychiatry, 72, 1172–1181.
pubmed: 26509694
doi: 10.1001/jamapsychiatry.2015.1737
Picard, R. R., & Cook, R. D. (1984). Cross-validation of regression models. Journal of the American Statistical Association, 79, 575–583.
doi: 10.1080/01621459.1984.10478083
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21.
pubmed: 25889199
pmcid: 4328074
doi: 10.1186/s13012-015-0209-1
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999). Population growth of human Y chromosomes: A study of Y chromosome microsatellites. Molecular Biology and Evolution, 16, 1791–1798.
pubmed: 10605120
doi: 10.1093/oxfordjournals.molbev.a026091
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38, 65–76.
pubmed: 20957426
doi: 10.1007/s10488-010-0319-7
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8, 1–11.
doi: 10.1186/1748-5908-8-139
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science: IS, 3, 26–26.
pubmed: 18485219
pmcid: 2396668
doi: 10.1186/1748-5908-3-26
Roshanaei-Moghaddam, B. M. D., & Katon, W. M. D. (2009). Premature mortality from general medical illnesses among persons with bipolar disorder: a review. Psychiatric Services, 60, 147–156.
pubmed: 19176408
doi: 10.1176/ps.2009.60.2.147
Roth, J., Sant'Anna, P. H. C., Bilinski, A., & Poe, J. (2022). What's trending in difference-in-differences? A synthesis of the recent economics literature. Working Paper. https://arxiv.org/pdf/2201.01194.pdf
Schuler, M. S., Griffin, B. A., Cerdá, M., McGinty, E. E., & Stuart, E. A. (2021). Methodological challenges and proposed solutions for evaluating opioid policy effectiveness. Health Services and Outcomes Research Methodology, 21, 21–41.
pubmed: 33883971
doi: 10.1007/s10742-020-00228-2
Shinozaki, T., & Suzuki, E. 2020. Understanding marginal structural models for time-varying exposures: pitfalls and tips. Journal of Epidemiology, JE20200226.
Siokou, C., Morgan, R., & Shiell, A. (2014). Group model building: A participatory approach to understanding and acting on systems. Public Health Res Pract, 25, e2511404.
pubmed: 25828443
doi: 10.17061/phrp2511404
Smith, N., Martins, S. S., Kim, J., Rivera-Aguirre, A., Fink, D. S., Castillo-Carniglia, A., Henry, S. G., Mooney, S. J., Marshall, B. D. L., & Davis, C. (2019). A typology of prescription drug monitoring programs: A latent transition analysis of the evolution of programs from 1999 to 2016. Addiction, 114, 248–258.
pubmed: 30207015
doi: 10.1111/add.14440
Stone, E. M., Daumit, G. L., Kennedy-Hendricks, A., & McGinty, E. E. (2020). The policy ecology of behavioral health homes: Case study of Maryland’s Medicaid health home program. Administration and Policy in Mental Health and Mental Health Services Research, 47, 60–72.
pubmed: 31506860
doi: 10.1007/s10488-019-00973-8
Stuart, E. A. (2010). “Matching methods for causal inference: A review and a look forward”, Statistical science: A review journal of the Institute of Mathematical. Statistics, 25, 1.
Stuart, E. A., Schmid, I., Nguyen, T., Sarker, E., Pittman, A., Benke, K., Rudolph, K., Badillo-Goicoechea, E., & Leoutsakos, J.-M. (2021). Assumptions not often assessed or satisfied in published mediation analyses in psychology and psychiatry. Epidemiologic Reviews, 43, 48–52.
pmcid: 8900288
doi: 10.1093/epirev/mxab007
Weeks, M. R., Li, J., Lounsbury, D., Green, H. D., Abbott, M., Berman, M., Rohena, L., Gonzalez, R., Lang, S., & Mosher, H. (2017). Using participatory system dynamics modeling to examine the local HIV test and treatment care continuum in order to reduce community viral load. American Journal of Community Psychology, 60, 584–598.
pubmed: 29154393
pmcid: 5729085
doi: 10.1002/ajcp.12204
West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des, D. C., Jarlais, D. H., Szapocznik, J., Fishbein, M., Rapkin, B., & Clatts, M. (2008). Alternatives to the randomized controlled trial. American Journal of Public Health, 98, 1359–1366.
pubmed: 18556609
pmcid: 2446460
doi: 10.2105/AJPH.2007.124446
Whitaker, R. G., Sperber, N., Baumgartner, M., Thiem, A., Cragun, D., Damschroder, L., Miech, E. J., Slade, A., & Birken, S. (2020). Coincidence analysis: A new method for causal inference in implementation science. Implementation Science, 15, 1–10.
doi: 10.1186/s13012-020-01070-3