Predicting criminal offence in adolescents who exhibit antisocial behaviour: a machine learning study using data from a large randomised controlled trial of multisystemic therapy.

Criminal offending Machine learning Prediction modelling Recidivism Youth crime

Journal

European child & adolescent psychiatry
ISSN: 1435-165X
Titre abrégé: Eur Child Adolesc Psychiatry
Pays: Germany
ID NLM: 9212296

Informations de publication

Date de publication:
08 Oct 2024
Historique:
received: 29 09 2023
accepted: 30 09 2024
medline: 8 10 2024
pubmed: 8 10 2024
entrez: 8 10 2024
Statut: aheadofprint

Résumé

Accurate prediction of short-term offending in young people exhibiting antisocial behaviour could support targeted interventions. Here we develop a set of machine learning (ML) models that predict offending status with good accuracy; furthermore, we show interpretable ML analyses can complement models to inform clinical decision-making. This study included 679 individuals aged 11-17 years who displayed moderate-to-severe antisocial behaviour, from a controlled trial of Multisystemic-therapy in England. The outcome was any criminal offence in the 18 months after study baseline. Four types of ML algorithms were trained: logistic regression, elastic net regression, random forest, and gradient boosting machine (GBM). Prediction models were developed (1) using predictors readily available to clinicians (e.g. sociodemographics, previous convictions), and (2) with additional information (e.g. parenting). Model agnostic feature importance values were calculated and the most important predictors identified. Nested cross-validation with 100 iterations of random data splits and 10-fold cross-validation within each iteration was employed, and the average predictive performance was reported. Among the ML models using readily available predictors, the GBM is the strongest model (AUC 0.85, 95% CI 0.85-0.86); the other models have average AUCs of 0.82. This performance was better than using only the total number of previous offences as the predictor (0.67, 0.66-0.68), and the model simply assuming past offending status as the prediction (0.81, 0.80-0.81). Additional predictors slightly increased the performance of logistic regression and random forest models but decreased the performance of elastic net regression and gradient boosting machine-based models. The potential utility of ML approaches for accurately predicting criminal offences in high-risk youth is demonstrated. Interpretable ML-based predictive models could be utilised in youth services or research to help develop and deliver effective interventions.

Identifiants

pubmed: 39377792
doi: 10.1007/s00787-024-02592-7
pii: 10.1007/s00787-024-02592-7
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Informations de copyright

© 2024. The Author(s).

Références

National Institute for Health and Care Excellence (NICE) Antisocial behaviour and conduct disorders in children and young people: recognition and management (Clinical guideline [CG158])2013 Accessed 31 May 2023. https://www.nice.org.uk/guidance/cg158
Patalay P, Gage SH (2019) Changes in millennial adolescent mental health and health-related behaviours over 10 years: a population cohort comparison study. Int J Epidemiol 48(5):1650–1664. https://doi.org/10.1093/ije/dyz006
doi: 10.1093/ije/dyz006 pubmed: 30815691 pmcid: 6904321
World Health Organization (WHO) (2021) Adolescent mental health https://www.who.int/news-room/fact-sheets/detail/adolescent-mental-health
Testa A, Semenza DC (2020) Criminal offending and health over the life-course: a dual-trajectory approach. J Criminal Justice 68:101691. https://doi.org/10.1016/j.jcrimjus.2020.101691
doi: 10.1016/j.jcrimjus.2020.101691
Fergusson DM, Horwood LJ, Ridder EM (2005) Show me the child at seven: the consequences of conduct problems in childhood for psychosocial functioning in adulthood. J Child Psychol Psychiatry 46(8):837–849. https://doi.org/10.1111/j.1469-7610.2004.00387.x
doi: 10.1111/j.1469-7610.2004.00387.x pubmed: 16033632
Parsons S, Bryson A, Sullivan A (2022) Teenage conduct problems: a lifetime of disadvantage in the labour market? Oxf Econ Pap gpac039. https://doi.org/10.1093/oep/gpac039
Boisjoli R, Vitaro F, Lacourse É, Barker ED, Tremblay RE (2007) Impact and clinical significance of a preventive intervention for disruptive boys: 15-year follow-up. Br J Psychiatry 191(5):415–419. https://doi.org/10.1192/bjp.bp.106.030007
doi: 10.1192/bjp.bp.106.030007 pubmed: 17978321
Dekovic M, Slagt MI, Asscher JJ, Boendermaker L, Eichelsheim VI, Prinzie P (2011) Effects of early prevention programs on adult criminal offending: a meta-analysis. Clin Psychol Rev 31(4):532–544. https://doi.org/10.1016/j.cpr.2010.12.003
doi: 10.1016/j.cpr.2010.12.003 pubmed: 21239100
Farrington DP, Ttofi MM, Piquero AR (2016) Risk, promotive, and protective factors in youth offending: results from the Cambridge study in delinquent development. J Criminal Justice 45:63–70. https://doi.org/10.1016/j.jcrimjus.2016.02.014
doi: 10.1016/j.jcrimjus.2016.02.014
Fergusson D, Swain-Campbell N, Horwood J (2004) How does childhood economic disadvantage lead to crime? J Child Psychol Psychiatry 45(5):956–966. https://doi.org/10.1111/j.1469-7610.2004.t01-1-00288.x
doi: 10.1111/j.1469-7610.2004.t01-1-00288.x pubmed: 15225338
Nikulina V, Widom CS, Czaja S (2011) The role of Childhood Neglect and Childhood Poverty in Predicting Mental Health, Academic Achievement and Crime in Adulthood. Am J Community Psychol 48(3–4):309–321. https://doi.org/10.1007/s10464-010-9385-y
doi: 10.1007/s10464-010-9385-y pubmed: 21116706 pmcid: 7197378
Young S, Taylor E, Gudjonsson G (2016) Childhood predictors of criminal offending: results from a 19-Year Longitudinal Epidemiological Study of boys. J Atten Disord 20(3):206–213. https://doi.org/10.1177/1087054712461934
doi: 10.1177/1087054712461934 pubmed: 23204061
Dressel J, Farid H (2018) The accuracy, fairness, and limits of predicting recidivism. Sci Adv 4(1):eaao5580. https://doi.org/10.1126/sciadv.aao5580
doi: 10.1126/sciadv.aao5580 pubmed: 29376122 pmcid: 5777393
Travaini GV, Pacchioni F, Bellumore S, Bosia M, De Micco F (2022) Machine learning and criminal justice: a systematic review of Advanced Methodology for Recidivism Risk Prediction. Int J Environ Res Public Health 19(17). https://doi.org/10.3390/ijerph191710594
Pelham WE, Petras H, Pardini DA (2020) Can Machine Learning improve screening for targeted Delinquency Prevention Programs? Prev Sci 21(2):158–170. https://doi.org/10.1007/s11121-019-01040-2
doi: 10.1007/s11121-019-01040-2 pubmed: 31696355 pmcid: 7041896
Koh LL, Day A, Klettke B, Daffern M, Chu CM (2020) The predictive validity of youth violence risk assessment tools: a systematic review. Psychol Crime Law 26(8):776–796. https://doi.org/10.1080/1068316X.2020.1734200
doi: 10.1080/1068316X.2020.1734200
Barboni L, von Hagen A, Piñeyro S, Senabre I (2023) Predictive validity of the structured assessment of violence risk in youth (SAVRY) on the recidivism of juvenile offenders: a systematic review. Psychol Crime Law 1–27. https://doi.org/10.1080/1068316X.2023.2214661
Rudin C (2019) Stop Explaining Black Box Machine Learning Models for high stakes decisions and use interpretable models instead. Nat Mach Intell 1(5):206–215. https://doi.org/10.1038/s42256-019-0048-x
doi: 10.1038/s42256-019-0048-x pubmed: 35603010 pmcid: 9122117
Cleophas TJ, Zwinderman AH (2013) Machine learning in Medicine, 1 edn. Springer Dordrecht
Collins GS, Reitsma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ: Br Med J 350:g7594. https://doi.org/10.1136/bmj.g7594
doi: 10.1136/bmj.g7594
Fonagy P, Butler S, Cottrell D, Scott S, Pilling S, Eisler I et al (2018) Multisystemic therapy versus management as usual in the treatment of adolescent antisocial behaviour (START): a pragmatic, randomised controlled, superiority trial. Lancet Psychiatry 5(2):119–133. https://doi.org/10.1016/S2215-0366(18)30001-4
doi: 10.1016/S2215-0366(18)30001-4 pubmed: 29307527 pmcid: 6697182
Fonagy P, Butler S, Cottrell D, Scott S, Pilling S, Eisler I et al (2020) Multisystemic therapy versus management as usual in the treatment of adolescent antisocial behaviour (START): 5-year follow-up of a pragmatic, randomised, controlled, superiority trial. Lancet Psychiatry 7(5):420–430. https://doi.org/10.1016/S2215-0366(20)30131-0
doi: 10.1016/S2215-0366(20)30131-0 pubmed: 32353277
Henggeler S, Schoenwald S, Borduin C, Rowland M, Cunningham P (2009) Multisystemic therapy for antisocial behavior in children and adolescents, 2nd edn. Guildford, New York: NY
NICE (2010) Antisocial personality disorder: treatment, management and prevention. The British Psychological Society and the Royal College of Psychiatrists, London, UK
NICE (2013) Conduct disorders and antisocial behaviour in children and young people: recognition, intervention and management (CG158). British Psychological Society and Royal College of Psychiatrists, London, UK
Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41(5):645–655
doi: 10.1111/j.1469-7610.2000.tb02345.x pubmed: 10946756
Zou H, Hastie T (2005) Regularization and Variable Selection Via the Elastic Net. J Royal Stat Soc Ser B: Stat Methodol 67(2):301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
doi: 10.1111/j.1467-9868.2005.00503.x
Breiman L, Random, Forests (2001) Mach Learn 45(1):5–32. https://doi.org/10.1023/A:1010933404324
doi: 10.1023/A:1010933404324
Friedman JH (2002) Stochastic gradient boosting. Comput Stat Data Anal 38(4):367–378. https://doi.org/10.1016/S0167-9473(01)00065-2
doi: 10.1016/S0167-9473(01)00065-2
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O et al (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
Jankowsky K, Krakau L, Schroeders U, Zwerenz R, Beutel ME (2024) Predicting treatment response using machine learning: a registered report. Br J Clin Psychol 63(2):137–155. https://doi.org/10.1111/bjc.12452
doi: 10.1111/bjc.12452 pubmed: 38111213
Stekhoven DJ, Buhlmann P (2012) MissForest–non-parametric missing value imputation for mixed-type data. Bioinformatics 28(1):112–118. https://doi.org/10.1093/bioinformatics/btr597
doi: 10.1093/bioinformatics/btr597 pubmed: 22039212
Lundberg SM, Lee S-I et al (2017) A Unified Approach to Interpreting Model Predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, editors
Kurlychek MC, Brame R, Bushway SD (2006) Scarlet letters and recidivism: does an old criminal record predict future offending? Criminol Public Policy 5(3):483–504. https://doi.org/10.1111/j.1745-9133.2006.00397.x
doi: 10.1111/j.1745-9133.2006.00397.x
Blokland AAJ, Nieuwbeerta P, Australian (2010) New Z J Criminol 43(3):526–556. https://doi.org/10.1375/acri.43.3.526
doi: 10.1375/acri.43.3.526
Nagin DS, Paternoster R (1991) On the relationship of past to future participation in delinquency. Criminology 29(2):163–189. https://doi.org/10.1111/j.1745-9125.1991.tb01063.x
doi: 10.1111/j.1745-9125.1991.tb01063.x
White JL, Moffitt TE, Silva PA (1989) A prospective replication of the protective effects of IQ in subjects at high risk for juvenile delinquency. J Consult Clin Psychol 57(6):719–724. https://doi.org/10.1037//0022-006x.57.6.719
doi: 10.1037/0022-006X.57.6.719 pubmed: 2600242
Levine SZ (2011) Elaboration on the association between IQ and parental SES with subsequent crime. Pers Indiv Differ 50(8):1233–1237. https://doi.org/10.1016/j.paid.2011.02.016
doi: 10.1016/j.paid.2011.02.016
Sweeten G, Piquero AR, Steinberg L (2013) Age and the explanation of crime, revisited. J Youth Adolesc 42(6):921–938. https://doi.org/10.1007/s10964-013-9926-4
doi: 10.1007/s10964-013-9926-4 pubmed: 23412690
Shulman EP, Steinberg LD, Piquero AR (2013) The age-crime curve in adolescence and early adulthood is not due to age differences in economic status. J Youth Adolesc 42(6):848–860. https://doi.org/10.1007/s10964-013-9950-4
doi: 10.1007/s10964-013-9950-4 pubmed: 23595417
Dietterich T (1995) Overfitting and undercomputing in machine learning. ACM Comput Surv 27(3):326–327. https://doi.org/10.1145/212094.212114
doi: 10.1145/212094.212114
Hastie T, Tibshirani R, Friedman J The elements of statistical learning. 2 ed: Springer New York, NY; 2009 26 August 2009. XXII, 745 p
Li J, Cheng K, Wang S, Morstatter F, Trevino RP, Tang J et al (2017) Feature selection: A Data Perspective. ACM Comput Surv 50(6):Article. https://doi.org/10.1145/3136625
doi: 10.1145/3136625

Auteurs

Jae Won Suh (JW)

CORE Data Lab, Centre for Outcomes Research and Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, UK. j.suh@ucl.ac.uk.

Rob Saunders (R)

CORE Data Lab, Centre for Outcomes Research and Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.

Elizabeth Simes (E)

Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.

Henry Delamain (H)

CORE Data Lab, Centre for Outcomes Research and Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.

Stephen Butler (S)

Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.
Department of Psychology, University of Prince Edward Island, Charlottetown, Canada.

David Cottrell (D)

Leeds Institute of Health Sciences, University of Leeds, Leeds, UK.

Abdullah Kraam (A)

University of Leeds, Leeds, UK.

Stephen Scott (S)

Institute of Psychiatry, Psychology and Neuroscience, National Academy for Parenting Research, Kings's College London, London, UK.

Ian M Goodyer (IM)

Department of Psychiatry, University of Cambridge, Cambridge, UK.

James Wason (J)

Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK.

Stephen Pilling (S)

CORE Data Lab, Centre for Outcomes Research and Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.

Peter Fonagy (P)

Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.

Classifications MeSH