The Effectiveness of Psychological Interventions Delivered in Routine Practice: Systematic Review and Meta-analysis.
Effectiveness
Meta-analysis
Naturalistic
Psychotherapy
Routine outcomes
Journal
Administration and policy in mental health
ISSN: 1573-3289
Titre abrégé: Adm Policy Ment Health
Pays: United States
ID NLM: 8914574
Informations de publication
Date de publication:
01 2023
01 2023
Historique:
accepted:
14
09
2022
pubmed:
7
10
2022
medline:
13
1
2023
entrez:
6
10
2022
Statut:
ppublish
Résumé
This review presents a comprehensive evaluation of the effectiveness of routinely delivered psychological therapies across inpatient, outpatient and University-based clinics. This was a pre-registered systematic-review of studies meeting pre-specified inclusion criteria (CRD42020175235). Eligible studies were searched in three databases: MEDLINE, CINAHL and PsycInfo. Pre-post treatment (uncontrolled) effect sizes were calculated and pooled using random effects meta-analysis to generate effectiveness benchmarks. Moderator analyses were used to examine sources of heterogeneity in effect sizes. Overall, 252 studies (k = 298 samples) were identified, of which 223 (k = 263 samples) provided sufficient data for inclusion in meta-analysis. Results showed large pre-post treatment effects for depression [d = 0.96, (CI 0.88-1.04), p ≤ 0.001, k = 122], anxiety [d = 0.8 (CI 0.71-0.9), p ≤ 0.001, k = 69], and other outcomes [d = 1.01 (CI 0.93-1.09), p ≤ 0.001, k = 158]. This review provides support for the effectiveness of routinely delivered psychological therapy. Effectiveness benchmarks are supplied to support service evaluations across multiple settings.
Identifiants
pubmed: 36201113
doi: 10.1007/s10488-022-01225-y
pii: 10.1007/s10488-022-01225-y
pmc: PMC9832112
doi:
Types de publication
Meta-Analysis
Systematic Review
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
43-57Informations de copyright
© 2022. The Author(s).
Références
Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331–339. https://doi.org/10.1037/0022-006X.68.2.331
doi: 10.1037/0022-006X.68.2.331
APA. (2006). Evidence-based practice in psychology. Presidential Task Force on Evidence-Based Practice. American Psychologist, 61, 271–285.
doi: 10.1037/0003-066X.61.4.271
Armijo-Olivo, S., Ospina, M., da Costa, B. R., Egger, M., Saltaji, H., Fuentes, J., Ha, C., & Cummings, G. G. (2014). Poor reliability between Cochrane reviewers and blinded external reviewers when applying the Cochrane risk of bias tool in physical therapy trials. PLoS ONE, 9(5), e96920. https://doi.org/10.1371/journal.pone.0096920
doi: 10.1371/journal.pone.0096920
Balk, E. M., Earley, A., Patel, K., Trikalinos, T. A., & Dahabreh, I. J. (2012). Empirical assessment of within-arm correlation imputation in trials of continuous outcomes. Methods Research Reports, 12(13), EHC141-EF.
Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Benson, L., Connell, J., Audin, K., & McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69(2), 184–196. https://doi.org/10.1037/0022-006X.69.2.184
doi: 10.1037/0022-006X.69.2.184
Barkham, M., Stiles, W. B., Lambert, M. J., & Mellor-Clark, J. (2010). Building a rigorous and relevant knowledge base for the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence (pp. 21–61). Wiley. https://doi.org/10.1002/9780470687994.ch2
doi: 10.1002/9780470687994.ch2
Becker, B. J. (1988). Synthesizing standardized mean-change measures. British Journal of Mathematical & Statistical Psychology, 41(2), 257–278. https://doi.org/10.1111/j.2044-8317.1988.tb00901
doi: 10.1111/j.2044-8317.1988.tb00901
Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. https://doi.org/10.2307/2533446
doi: 10.2307/2533446
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021). Introduction to meta-analysis. Wiley.
doi: 10.1002/9781119558378
Cahill, J., Barkham, M., & Stiles, W. (2010). Systematic review of practice-based research on psychological therapies in routine clinic settings. The British Journal of Clinical Psychology, 49(4), 421–453. https://doi.org/10.1348/014466509X470789
doi: 10.1348/014466509X470789
Card, N. A. (2015). Applied meta-analysis for social science research. Guilford Publications.
Castonguay, L. G., Barkham, M., Jeong Youn, S., & Page, A. C. (2021). Practice-based evidence findings from routine clinical settings. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change (7th ed., pp. 191–222). Wiley.
Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-orienIrach: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). Wiley.
Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66(1), 7–18. https://doi.org/10.1037//0022-006x.66.1.7
doi: 10.1037//0022-006x.66.1.7
Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Empirically Supported Psychological Interventions: Controversies and Evidence, 52(1), 685–716. https://doi.org/10.1146/annurev.psych.52.1.685
doi: 10.1146/annurev.psych.52.1.685
Clark, D. M., Canvin, L., Green, J., Layard, R., Pilling, S., & Janecka, M. (2018). Transparency about the outcomes of mental health services (IAPT approach): An analysis of public data. The Lancet, 391(10121), 679–686. https://doi.org/10.1016/S0140-6736(17)32133-5
doi: 10.1016/S0140-6736(17)32133-5
Cochran, W. G. (1954). The combination of estimates from different experiments. Biometrics, 10(1), 101–129. https://doi.org/10.2307/3001666
doi: 10.2307/3001666
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104
doi: 10.1177/001316446002000104
Connell, J., Barkham, M., & Mellor-Clark, J. (2007). CORE-OM mental health norms of students attending university counselling services benchmarked against an age-matched primary care sample. British Journal of Guidance & Counselling, 35(1), 41–57. https://doi.org/10.1080/03069880601106781
doi: 10.1080/03069880601106781
Cooper, H. M. (1998). Synthesizing research: A guide for literature reviews. SAGE.
Cuijpers, P. (2016). Meta-analyses in mental health research: A practical guide. University of Amsterdam.
Cuijpers, P., Li, J., Hofmann, S. G., & Andersson, G. (2010). Self-reported versus clinician-rated symptoms of depression as outcome measures in psychotherapy research on depression: A meta-analysis. Clinical Psychology Review, 30(6), 768–778. https://doi.org/10.1016/j.cpr.2010.06.001
doi: 10.1016/j.cpr.2010.06.001
Cuijpers, P., Sijbrandij, M., Koole, S., Huibers, M., Berking, M., & Andersson, G. (2014a). Psychological treatment of generalized anxiety disorder: A meta-analysis. Clinical Psychology Review, 34(2), 130–140. https://doi.org/10.1016/j.cpr.2014.01.002
doi: 10.1016/j.cpr.2014.01.002
Cuijpers, P., Turner, E. H., Mohr, D. C., Hofmann, S. G., Andersson, G., Berking, M., & Coyne, J. (2014b). Comparison of psychotherapies for adult depression to pill placebo control groups: A meta-analysis. Psychological Medicine, 44(4), 685–695. https://doi.org/10.1017/S0033291713000457
doi: 10.1017/S0033291713000457
Cuijpers, P., van Straten, A., Andersson, G., & van Oppen, P. (2008). Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology, 76(6), 909–922. https://doi.org/10.1037/a0013075
doi: 10.1037/a0013075
Delgadillo, J., McMillan, D., Leach, C., Lucock, M., Gilbody, S., & Wood, N. (2014). Benchmarking routine psychological services: A discussion of challenges and methods. Behavioural and Cognitive Psychotherapy, 42(1), 16–30. https://doi.org/10.1017/S135246581200080X
doi: 10.1017/S135246581200080X
Driessen, E., Cuijpers, P., Hollon, S. D., & Dekker, J. J. M. (2010). Does pretreatment severity moderate the efficacy of psychological treatment of adult outpatient depression? A meta-analysis. Journal of Consulting and Clinical Psychology, 78(5), 668–680. https://doi.org/10.1037/a0020570
doi: 10.1037/a0020570
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
doi: 10.1136/bmj.315.7109.629
Flückiger, C., Del Re, A. C., Barth, J., Hoyt, W. T., Levitt, H., Munder, T., Spielmans, G. I., Swift, J. K., Vîslă, A., & Wampold, B. E. (2018). Considerations of how to conduct meta-analyses in psychological interventions. Psychotherapy Research, 28(3), 329–332. https://doi.org/10.1080/10503307.2018.1430390
doi: 10.1080/10503307.2018.1430390
Freedland, K. E., Mohr, D. C., Davidson, K. W., & Schwartz, J. E. (2011). Usual and unusual care: Existing practice control groups in randomized controlled trials of behavioral interventions. Psychosomatic Medicine, 73(4), 323–335. https://doi.org/10.1097/PSY.0b013e318218e1fb
doi: 10.1097/PSY.0b013e318218e1fb
Furukawa, T. A., Weitz, E. S., Tanaka, S., Hollon, S. D., Hofmann, S. G., Andersson, G., Twisk, J., DeRubeis, R. J., Dimidjian, S., Hegerl, U., Mergl, R., Jarrett, R. B., Vittengl, J. R., Watanabe, N., & Cuijpers, P. (2017). Initial severity of depression and efficacy of cognitive-behavioural therapy: Individual-participant data meta-analysis of pill-placebo-controlled trials. British Journal of Psychiatry, 210(3), 190–196. https://doi.org/10.1192/bjp.bp.116.187773
doi: 10.1192/bjp.bp.116.187773
Gleser, L. J., & Olkin, I. (2009). Stochastically dependent effect sizes. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 357–376). Russell Sage.
Gyani, A., Shafran, R., Layard, R., & Clark, D. M. (2013). Enhancing recovery rates: Lessons from year one of IAPT. Behaviour Research and Therapy, 51(9), 597–606. https://doi.org/10.1016/j.brat.2013.06.004
doi: 10.1016/j.brat.2013.06.004
Hans, E., & Hiller, W. (2013). Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: A meta-analysis of nonrandomized effectiveness studies. Journal of Consulting and Clinical Psychology, 81(1), 75–88. https://doi.org/10.1037/a0031080
doi: 10.1037/a0031080
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2019). Dmetar: Companion R package for the guide ‘doing meta-analysis in R’. [R Package].
Higgins, J., & Thompson, S. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186
doi: 10.1002/sim.1186
Hoyt, W. T., & Del Re, A. C. (2018). Effect size calculation in meta-analyses of psychotherapy outcome research. Psychotherapy Research, 28(3), 379–388. https://doi.org/10.1080/10503307.2017.1405171
doi: 10.1080/10503307.2017.1405171
Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38(1), 21–33. https://doi.org/10.1037/0735-7028.38.1.21
doi: 10.1037/0735-7028.38.1.21
Jüni, P., Altman, D. G., & Egger, M. (2001). Assessing the quality of controlled clinical trials. BMJ, 323(7303), 42–46.
doi: 10.1136/bmj.323.7303.42
Lambert, M. J. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert & A. E. Bergin (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 169–218). Wiley.
Lemma, A., Roth, A. D., & Pilling, S. (2008). The competences required to deliver effective psychoanalytic/psychodynamic therapy. Research Department of Clinical, Educational and Health Psychology, University College London.
Lewis, C., Roberts, N. P., Andrew, M., Starling, E., & Bisson, J. I. (2020). Psychological therapies for post-traumatic stress disorder in adults: Systematic review and meta-analysis. European Journal of Psychotraumatology, 11(1), 1729633. https://doi.org/10.1080/20008198.2020.1729633
doi: 10.1080/20008198.2020.1729633
Linardon, J., Wade, T. D., de la Piedad Garcia, X., & Brennan, L. (2017). The efficacy of cognitive-behavioral therapy for eating disorders: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 85(11), 1080–1094. https://doi.org/10.1037/ccp0000245
doi: 10.1037/ccp0000245
Lutz, W., Schiefele, A.-K., Wucherpfennig, F., Rubel, J., & Stulz, N. (2016). Clinical effectiveness of cognitive behavioral therapy for depression in routine care: A propensity score based comparison between randomized controlled trials and clinical practice. Journal of Affective Disorders, 189(1), 150–158. https://doi.org/10.1016/j.jad.2015.08.072
doi: 10.1016/j.jad.2015.08.072
Margison, F. R., Barkham, M., Evans, C., McGrath, G., Clark, J. M., Audin, K., & Connell, J. (2000). Measurement and psychotherapy: Evidence-based practice and practice-based evidence. British Journal of Psychiatry, 177(2), 123–130. https://doi.org/10.1192/bjp.177.2.123
doi: 10.1192/bjp.177.2.123
Mayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2014). Psychological and pharmacological interventions for social anxiety disorder in adults: A systematic review and network meta-analysis. The Lancet Psychiatry, 1(5), 368–376. https://doi.org/10.1016/S2215-0366(14)70329-3
doi: 10.1016/S2215-0366(14)70329-3
McAleavey, A. A., Youn, S. J., Xiao, H., Castonguay, L. G., Hayes, J. A., & Locke, B. D. (2019). Effectiveness of routine psychotherapy: Methods matters. Psychotherapy Research, 29, 139–156.
doi: 10.1080/10503307.2017.1395921
Minami, T., Serlin, R. C., Wampold, B. E., Kircher, J. C., & Brown, G. S. (2008). Using clinical trials to benchmark effects produced in clinical practice. Quality and Quantity, 42(4), 513–525. https://doi.org/10.1007/s11135-006-9057-z
doi: 10.1007/s11135-006-9057-z
Morris, S. B. (2008). Estimating effect sizes from pretest–posttest-control group designs. Organizational Research Methods, 11(2), 364–386. https://doi.org/10.1177/1094428106291059
doi: 10.1177/1094428106291059
Munder, T., & Barth, J. (2018). Cochrane’s risk of bias tool in the context of psychotherapy outcome research. Psychotherapy Research, 28(3), 347–355. https://doi.org/10.1080/10503307.2017.1411628
doi: 10.1080/10503307.2017.1411628
Munn, Z., Barker, T. H., Moola, S., Tufanaru, C., Stern, C., McArthur, A., Stephenson, M., & Aromataris, E. (2020). Methodological quality of case series studies: An introduction to the JBI critical appraisal tool. JBI Evidence Synthesis, 18(10), 2127–2133. https://doi.org/10.11124/JBISRIR-D-19-00099
doi: 10.11124/JBISRIR-D-19-00099
National Institute for Health and Care Excellence. (2011). Common mental health problems: Identification and pathways to care (CG90). https://www.nice.org.uk/guidance/cg123/chapter/1-guidance
Nordmo, M., Sønderland, N. M., Havik, O. E., Eilertsen, D.-E., Monsen, J. T., & Solbakken, O. A. (2020). Effectiveness of open-ended psychotherapy under clinically representative conditions. Frontiers in Psychiatry, 11, 384. https://doi.org/10.3389/fpsyt.2020.00384
doi: 10.3389/fpsyt.2020.00384
Olatunji, B. O., Kauffman, B. Y., Meltzer, S., Davis, M. L., Smits, J. A. J., & Powers, M. B. (2014). Cognitive-behavioral therapy for hypochondriasis/health anxiety: A meta-analysis of treatment outcome and moderators. Behaviour Research and Therapy, 58, 65–74. https://doi.org/10.1016/j.brat.2014.05.002
doi: 10.1016/j.brat.2014.05.002
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., …, Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Medicine, 18(3), e1003583. https://doi.org/10.1371/journal.pmed.1003583
doi: 10.1371/journal.pmed.1003583
Persons, J. B., Bostrom, A., & Bertagnolli, A. (1999). Results of randomized controlled trials of cognitive therapy for depression generalize to private practice. Cognitive Therapy and Research, 23(5), 535–548. https://doi.org/10.1023/A:1018724505659
doi: 10.1023/A:1018724505659
Posternak, M. A., & Miller, I. (2001). Untreated short-term course of major depression: A meta-analysis of outcomes from studies using wait-list control groups. Journal of Affective Disorders, 66(2–3), 139–146. https://doi.org/10.1016/s0165-0327(00)00304-9
doi: 10.1016/s0165-0327(00)00304-9
Power, N., Noble, L., Simmonds-Buckley, M., Kellett, S., Stockton, C., Firth, N., & Delgadillo, J. (2022). Associations between treatment adherence-competence-integrity (ACI) and adult psychotherapy outcomes: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 90(5), 427–445. https://doi.org/10.1037/ccp0000736
doi: 10.1037/ccp0000736
Pybis, J., Saxon, D., Hill, A., & Barkham, M. (2017). The comparative effectiveness and efficiency of cognitive behaviour therapy and generic counselling in the treatment of depression: Evidence from the 2nd UK National Audit of psychological therapies. BMC Psychiatry, 17(1), 1–13. https://doi.org/10.1186/s12888-017-1370-7
doi: 10.1186/s12888-017-1370-7
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
Rosa-Alcázar, A. I., Sánchez-Meca, J., Gómez-Conesa, A., & Marín-Martínez, F. (2008). Psychological treatment of obsessivecompulsive disorder: A meta-analysis. Clinical Psychology Review, 28(8), 1310–1325. https://doi.org/10.1016/j.cpr.2008.07.001
doi: 10.1016/j.cpr.2008.07.001
Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638
doi: 10.1037/0033-2909.86.3.638
Roth, A., Hill, A., & Pilling, S. (2009). The competences required to deliver effective humanistic psychological therapies. University College London.
Roth, A., & Pilling, S. (2008). Using an evidence-based methodology to identify the competences required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy, 36(2), 129–147. https://doi.org/10.1017/S1352465808004141
doi: 10.1017/S1352465808004141
Sánchez-Meca, J., Rosa-Alcázar, A. I., Marín-Martínez, F., & Gómez-Conesa, A. (2010). Psychological treatment of panic disorder with or without agoraphobia: A meta-analysis. Clinical Psychology Review, 30(1), 37–50. https://doi.org/10.1016/j.cpr.2009.08.011
doi: 10.1016/j.cpr.2009.08.011
Schwarzer, G. (2020). Meta: General package for meta-analysis. https://CRAN.R-project.org/package=meta
Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., Prout, H. T., Smith, M. L., Svartberg, M., & Weiss, B. (1997). Evidence that therapy works in clincally representative conditions. Journal of Consulting and Clinical Psychology, 65(3), 355–365. https://doi.org/10.1037/0022-006X.65.3.355
doi: 10.1037/0022-006X.65.3.355
Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin, 126(4), 512–529. https://doi.org/10.1037/0033-2909.126.4.512
doi: 10.1037/0033-2909.126.4.512
Spielmans, G. I., & Flückiger, C. (2018). Moderators in psychotherapy meta-analysis. Psychotherapy Research, 28(3), 333–346. https://doi.org/10.1080/10503307.2017.1422214
doi: 10.1080/10503307.2017.1422214
Stewart, R. E., & Chambless, D. L. (2009). Cognitive-behavioral therapy for adult anxiety disorders in clinical practice: A meta-analysis of effectiveness studies. Journal of Consulting and Clinical Psychology, 77(4), 595–606. https://doi.org/10.1037/a0016032
doi: 10.1037/a0016032
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013). Three-level meta-analysis of dependent effect sizes. Behavior Research Methods, 45(2), 576–594. https://doi.org/10.3758/s13428-012-0261-6
doi: 10.3758/s13428-012-0261-6
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015). Meta-analysis of multiple outcomes: A multilevel approach. Behavior Research Methods, 47(4), 1274–1294. https://doi.org/10.3758/s13428-014-0527-2
doi: 10.3758/s13428-014-0527-2
van der Lem, R., de Wever, W. W., van der Wee, N. J., van Veen, T., Cuijpers, P., & Zitman, F. G. (2012). The generalizability of psychotherapy efficacy trials in major depressive disorder: An analysis of the influence of patient selection in efficacy trials on symptom outcome in daily practice. BMC Psychiatry, 12(1), 192. https://doi.org/10.1186/1471-244X-12-192
doi: 10.1186/1471-244X-12-192
Viechtbauer, W. (2020). Metafor: Meta-analysis package for r. https://CRAN.R-project.org/package=metafor
Wakefield, S., Kellett, S., Simmonds-Buckley, M., Stockton, D., Bradbury, A., & Delgadillo, J. (2021). Improving Access to Psychological Therapies (IAPT) in the United Kingdom: A systematic review and meta-analysis of 10-years of practice-based evidence. British Journal of Clinical Psychology, 60(1), 1–37. https://doi.org/10.1111/bjc.12259
doi: 10.1111/bjc.12259
Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117(3), 450–468. https://doi.org/10.1037/0033-2909.117.3.450
doi: 10.1037/0033-2909.117.3.450
Whiteford, H., Harris, M., Mckeon, G., Baxter, A., Pennell, C., Barendregt, J., & Wang, J. (2012). Estimating remission from untreated major depression: A systematic review and meta-analysis. Psychological Medicine, 43, 1–17. https://doi.org/10.1017/S0033291712001717
doi: 10.1017/S0033291712001717
Wolitzky-Taylor, K. B., Horowitz, J. D., Powers, M. B., & Telch, M. J. (2008). Psychological approaches in the treatment of specific phobias: A meta-analysis. Clinical Psychology Review, 28(6), 1021–1037. https://doi.org/10.1016/j.cpr.2008.02.007
doi: 10.1016/j.cpr.2008.02.007
Xiao, H., Carney, D. M., Youn, S. J., Janis, R. A., Castonguay, L. G., Hayes, J. A., & Locke, B. D. (2017). Are we in crisis? National mental health and treatment trends in college counseling centers. Psychological Services, 14(4), 407–415. https://doi.org/10.1037/ser0000130
doi: 10.1037/ser0000130
Zimmerman, M., Mattia, J. I., & Posternak, M. A. (2002). Are subjects in pharmacological treatment trials of depression representative of patients in routine clinical practice? American Journal of Psychiatry, 159(3), 469–473. https://doi.org/10.1176/appi.ajp.159.3.469
doi: 10.1176/appi.ajp.159.3.469