Predicting the conversion from clinically isolated syndrome to multiple sclerosis: An explainable machine learning approach.

Clinically isolated syndrome Explainability Machine learning Model Multiple sclerosis Prediction XGBoost

Journal

Multiple sclerosis and related disorders
ISSN: 2211-0356
Titre abrégé: Mult Scler Relat Disord
Pays: Netherlands
ID NLM: 101580247

Informations de publication

Date de publication:
09 Apr 2024
Historique:
received: 03 12 2023
revised: 04 04 2024
accepted: 07 04 2024
medline: 21 4 2024
pubmed: 21 4 2024
entrez: 20 4 2024
Statut: aheadofprint

Résumé

Predicting the conversion of clinically isolated syndrome (CIS) to clinically definite multiple sclerosis (CDMS) is critical to personalizing treatment planning and benefits for patients. The aim of this study is to develop an explainable machine learning (ML) model for predicting this conversion based on demographic, clinical, and imaging data. The ML model, Extreme Gradient Boosting (XGBoost), was employed on the public dataset of 273 Mexican mestizo CIS patients with 10-year follow-up. The data was divided into a training set for cross-validation and feature selection, and a holdout test set for final testing. Feature importance was determined using the SHapley Additive Explanations library (SHAP). Then, two experiments were conducted to optimize the model's performance by selectively adding variables and selecting the most contributive variables for the final model. Nine variables including age, gender, schooling, motor symptoms, infratentorial and periventricular lesion at imaging, oligoclonal band in cerebrospinal fluid, lesion and symptoms types were significant. The model achieved an accuracy of 83.6 %, AUC of 91.8 %, sensitivity of 83.9 %, and specificity of 83.4 % in cross-validation. In the final testing, the model achieved an accuracy of 78.3 %, AUC of 85.8 %, sensitivity of 75 %, and specificity of 81.1 %. Finally, a web-based demo of the model was created for testing purposes. The model, focusing on feature selection and interpretability, effectively stratifies risk for treatment decisions and disability prevention in MS patients. It provides a numerical risk estimate for CDMS conversion, enhancing transparency in clinical decision-making and aiding in patient care.

Identifiants

pubmed: 38642495
pii: S2211-0348(24)00188-3
doi: 10.1016/j.msard.2024.105614
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

105614

Informations de copyright

Copyright © 2024 Elsevier B.V. All rights reserved.

Déclaration de conflit d'intérêts

Declaration of competing interest All authors declare that they have no conflict of interest.

Auteurs

Saeid Rasouli (S)

School of Medicine, Five Senses Health Research Institute, Hazrat-e Rasool General Hospital, Iran University of Medical Sciences, Tehran, Iran. Electronic address: rasoulisaeid92@gmail.com.

Mohammad Sedigh Dakkali (MS)

Department of Ophthalmology, School of Medicine, Al Zahra Eye Hospital, Zahedan University of Medical Sciences, Zahedan, Iran.

Reza Azarbad (R)

Cellular and Molecular Biology Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran.

Azim Ghazvini (A)

School of Medicine, Iran University of Medical Sciences, Tehran, Iran.

Mahdi Asani (M)

Department of Ophthalmology, School of Medicine, Al Zahra Eye Hospital, Zahedan University of Medical Sciences, Zahedan, Iran.

Zahra Mirzaasgari (Z)

Department of Neurology, Firoozgar hospital, School of medicine, University of Medical Science, Iran.

Mohammed Arish (M)

Department of Ophthalmology, School of Medicine, Al Zahra Eye Hospital, Zahedan University of Medical Sciences, Zahedan, Iran.

Classifications MeSH