Development and validation of multivariable prediction models of remission, recovery, and quality of life outcomes in people with first episode psychosis: a machine learning approach.
Journal
The Lancet. Digital health
ISSN: 2589-7500
Titre abrégé: Lancet Digit Health
Pays: England
ID NLM: 101751302
Informations de publication
Date de publication:
10 2019
10 2019
Historique:
received:
09
08
2019
accepted:
12
08
2019
entrez:
16
12
2020
pubmed:
1
10
2019
medline:
28
1
2021
Statut:
ppublish
Résumé
Outcomes for people with first-episode psychosis are highly heterogeneous. Few reliable validated methods are available to predict the outcome for individual patients in the first clinical contact. In this study, we aimed to build multivariable prediction models of 1-year remission and recovery outcomes using baseline clinical variables in people with first-episode psychosis. In this machine learning approach, we applied supervised machine learning, using regularised regression and nested leave-one-site-out cross-validation, to baseline clinical data from the English Evaluating the Development and Impact of Early Intervention Services (EDEN) study (n=1027), to develop and internally validate prediction models at 1-year follow-up. We assessed four binary outcomes that were recorded at 1 year: symptom remission, social recovery, vocational recovery, and quality of life (QoL). We externally validated the prediction models by selecting from the top predictor variables identified in the internal validation models the variables shared with the external validation datasets comprised of two Scottish longitudinal cohort studies (n=162) and the OPUS trial, a randomised controlled trial of specialised assertive intervention versus standard treatment (n=578). The performance of prediction models was robust for the four 1-year outcomes of symptom remission (area under the receiver operating characteristic curve [AUC] 0·703, 95% CI 0·664-0·742), social recovery (0·731, 0·697-0·765), vocational recovery (0·736, 0·702-0·771), and QoL (0·704, 0·667-0·742; p<0·0001 for all outcomes), on internal validation. We externally validated the outcomes of symptom remission (AUC 0·680, 95% CI 0·587-0·773), vocational recovery (0·867, 0·805-0·930), and QoL (0·679, 0·522-0·836) in the Scottish datasets, and symptom remission (0·616, 0·553-0·679), social recovery (0·573, 0·504-0·643), vocational recovery (0·660, 0·610-0·710), and QoL (0·556, 0·481-0·631) in the OPUS dataset. In our machine learning analysis, we showed that prediction models can reliably and prospectively identify poor remission and recovery outcomes at 1 year for patients with first-episode psychosis using baseline clinical variables at first clinical contact. Lundbeck Foundation.
Sections du résumé
BACKGROUND
Outcomes for people with first-episode psychosis are highly heterogeneous. Few reliable validated methods are available to predict the outcome for individual patients in the first clinical contact. In this study, we aimed to build multivariable prediction models of 1-year remission and recovery outcomes using baseline clinical variables in people with first-episode psychosis.
METHODS
In this machine learning approach, we applied supervised machine learning, using regularised regression and nested leave-one-site-out cross-validation, to baseline clinical data from the English Evaluating the Development and Impact of Early Intervention Services (EDEN) study (n=1027), to develop and internally validate prediction models at 1-year follow-up. We assessed four binary outcomes that were recorded at 1 year: symptom remission, social recovery, vocational recovery, and quality of life (QoL). We externally validated the prediction models by selecting from the top predictor variables identified in the internal validation models the variables shared with the external validation datasets comprised of two Scottish longitudinal cohort studies (n=162) and the OPUS trial, a randomised controlled trial of specialised assertive intervention versus standard treatment (n=578).
FINDINGS
The performance of prediction models was robust for the four 1-year outcomes of symptom remission (area under the receiver operating characteristic curve [AUC] 0·703, 95% CI 0·664-0·742), social recovery (0·731, 0·697-0·765), vocational recovery (0·736, 0·702-0·771), and QoL (0·704, 0·667-0·742; p<0·0001 for all outcomes), on internal validation. We externally validated the outcomes of symptom remission (AUC 0·680, 95% CI 0·587-0·773), vocational recovery (0·867, 0·805-0·930), and QoL (0·679, 0·522-0·836) in the Scottish datasets, and symptom remission (0·616, 0·553-0·679), social recovery (0·573, 0·504-0·643), vocational recovery (0·660, 0·610-0·710), and QoL (0·556, 0·481-0·631) in the OPUS dataset.
INTERPRETATION
In our machine learning analysis, we showed that prediction models can reliably and prospectively identify poor remission and recovery outcomes at 1 year for patients with first-episode psychosis using baseline clinical variables at first clinical contact.
FUNDING
Lundbeck Foundation.
Identifiants
pubmed: 33323250
pii: S2589-7500(19)30121-9
doi: 10.1016/S2589-7500(19)30121-9
pii:
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
e261-e270Subventions
Organisme : Wellcome Trust
ID : 104025/Z/14/Z
Pays : United Kingdom
Organisme : Department of Health
ID : RDD/ARF2
Pays : United Kingdom
Organisme : Chief Scientist Office
ID : CAF/19/04
Pays : United Kingdom
Organisme : Chief Scientist Office
ID : CZH/4/295
Pays : United Kingdom
Organisme : Department of Health
ID : RP-PG-0109-10074
Pays : United Kingdom
Organisme : Chief Scientist Office
ID : CZH/3/5
Pays : United Kingdom
Commentaires et corrections
Type : CommentIn
Type : CommentIn
Type : CommentIn
Type : ErratumIn
Informations de copyright
Copyright © 2019 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.