Predicting postoperative outcomes in lumbar spinal fusion: development of a machine learning model.

Degenerative lumbar spondylolisthesis Machine learning Random forest Spinal fusion Support vector machine Xtreme gradient boosting

Journal

The spine journal : official journal of the North American Spine Society
ISSN: 1878-1632
Titre abrégé: Spine J
Pays: United States
ID NLM: 101130732

Informations de publication

Date de publication:
20 Oct 2023
Historique:
received: 08 06 2023
revised: 16 09 2023
accepted: 30 09 2023
pubmed: 23 10 2023
medline: 23 10 2023
entrez: 22 10 2023
Statut: aheadofprint

Résumé

Degenerative lumbar spondylolisthesis (DLS) is a prevalent spinal disorder, often requiring surgical intervention. Accurately predicting surgical outcomes is crucial to guide clinical decision-making, but this is challenging due to the multifactorial nature of postoperative results. Traditional risk assessment tools have limitations, and with the advent of machine learning, there is potential to enhance the precision and comprehensiveness of preoperative evaluations. We aimed to develop a machine-learning algorithm to predict surgical outcomes in patients with degenerative lumbar spondylolisthesis (DLS) undergoing spinal fusion surgery, only using preoperative data. Retrospective cross-sectional study. Patients with DLS undergoing lumbar spinal fusion surgery. This study aimed to predict the occurrence of lower back pain (LBP) ≥4 on the numeric analogue scale (NAS) 2 years after surgery. LBP was evaluated as the average pain patients experienced at rest in the week before questioning. NAS ranges from 0 to 10, 0 representing no pain and 10 representing the worst pain imaginable. We conducted a retrospective analysis of prospectively enrolled patients who underwent spinal fusion surgery for degenerative lumbar spondylolistheses at our institution in the United States between January 2016 and December 2018. The initial patient characteristics to be included in the training of the model were chosen by clinical expertise and through a literature review and included demographic characteristics, comorbidities, and radiologic features. The data was split into a training and validation datasets using a 60/40 split. Four different machine learning models were trained, including the modern XGBoost model, logistic regression, random-forest, and support vector machine (SVM). The models were evaluated according to the area under the curve (AUC) of the receiver operating characteristics (ROC) curve. An AUC of 0.7 to 0.8 was considered fair, 0.8 to 0.9 good, and ≥ 0.9 excellent. Additionally, a calibration plot and the Brier score were calculated for each model. A total of 135 patients (66% female) were included. A total of 38 (28%) patients reported LBP ≥ 4 after 2 years, representing the positive class. The XGBoost model demonstrated the best performance in the validation set with an AUC of 0.81 (95% CI 0.67-0.95). The other machine learning models performed significantly worse: with an AUC of 0.52 (95% CI 0.37-0.68) for the SVM, 0.56 (95% CI 0.37-0.76) for the logistic regression and an AUC of 0.56 (95% CI 0.37-0.78) for the random forest. In the XGBoost model age, composition of the erector spinae, and severity of lumbar spinal stenosis as were identified as the most important features. This study represents a novel approach to predicting surgical outcomes in spinal fusion patients. The XGBoost demonstrated a better performance compared with classical models and highlighted the potential contributions of age and paraspinal musculature atrophy as significant factors. These findings have important implications for enhancing patient care through the identification of high-risk individuals and modifiable risk factors. As the incorporation of machine learning algorithms into clinical decision-making continues to gain traction in research and clinical practice, our insights reinforce this trajectory by showcasing the potential of these techniques in forecasting surgical results.

Sections du résumé

BACKGROUND CONTEXT BACKGROUND
Degenerative lumbar spondylolisthesis (DLS) is a prevalent spinal disorder, often requiring surgical intervention. Accurately predicting surgical outcomes is crucial to guide clinical decision-making, but this is challenging due to the multifactorial nature of postoperative results. Traditional risk assessment tools have limitations, and with the advent of machine learning, there is potential to enhance the precision and comprehensiveness of preoperative evaluations.
PURPOSE OBJECTIVE
We aimed to develop a machine-learning algorithm to predict surgical outcomes in patients with degenerative lumbar spondylolisthesis (DLS) undergoing spinal fusion surgery, only using preoperative data.
STUDY DESIGN METHODS
Retrospective cross-sectional study.
PATIENT SAMPLE METHODS
Patients with DLS undergoing lumbar spinal fusion surgery.
OUTCOME MEASURES METHODS
This study aimed to predict the occurrence of lower back pain (LBP) ≥4 on the numeric analogue scale (NAS) 2 years after surgery. LBP was evaluated as the average pain patients experienced at rest in the week before questioning. NAS ranges from 0 to 10, 0 representing no pain and 10 representing the worst pain imaginable.
METHODS METHODS
We conducted a retrospective analysis of prospectively enrolled patients who underwent spinal fusion surgery for degenerative lumbar spondylolistheses at our institution in the United States between January 2016 and December 2018. The initial patient characteristics to be included in the training of the model were chosen by clinical expertise and through a literature review and included demographic characteristics, comorbidities, and radiologic features. The data was split into a training and validation datasets using a 60/40 split. Four different machine learning models were trained, including the modern XGBoost model, logistic regression, random-forest, and support vector machine (SVM). The models were evaluated according to the area under the curve (AUC) of the receiver operating characteristics (ROC) curve. An AUC of 0.7 to 0.8 was considered fair, 0.8 to 0.9 good, and ≥ 0.9 excellent. Additionally, a calibration plot and the Brier score were calculated for each model.
RESULTS RESULTS
A total of 135 patients (66% female) were included. A total of 38 (28%) patients reported LBP ≥ 4 after 2 years, representing the positive class. The XGBoost model demonstrated the best performance in the validation set with an AUC of 0.81 (95% CI 0.67-0.95). The other machine learning models performed significantly worse: with an AUC of 0.52 (95% CI 0.37-0.68) for the SVM, 0.56 (95% CI 0.37-0.76) for the logistic regression and an AUC of 0.56 (95% CI 0.37-0.78) for the random forest. In the XGBoost model age, composition of the erector spinae, and severity of lumbar spinal stenosis as were identified as the most important features.
CONCLUSIONS CONCLUSIONS
This study represents a novel approach to predicting surgical outcomes in spinal fusion patients. The XGBoost demonstrated a better performance compared with classical models and highlighted the potential contributions of age and paraspinal musculature atrophy as significant factors. These findings have important implications for enhancing patient care through the identification of high-risk individuals and modifiable risk factors. As the incorporation of machine learning algorithms into clinical decision-making continues to gain traction in research and clinical practice, our insights reinforce this trajectory by showcasing the potential of these techniques in forecasting surgical results.

Identifiants

pubmed: 37866485
pii: S1529-9430(23)03437-X
doi: 10.1016/j.spinee.2023.09.029
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Informations de copyright

Copyright © 2023 Elsevier Inc. All rights reserved.

Auteurs

Lukas Schönnagel (L)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA; Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Thomas Caffard (T)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA; Universitätsklinikum Ulm, Klinik für Orthopädie, Oberer Eselsberg 45, 89081 Ulm, Germany.

Tu-Lan Vu-Han (TL)

Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Jiaqi Zhu (J)

Biostatistics Core, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Isaac Nathoo (I)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Kyle Finos (K)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Gaston Camino-Willhuber (G)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Soji Tani (S)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA; Department of Orthopaedic Surgery, School of Medicine, Showa University Hospital, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo 142-8666, Japan.

Ali E Guven (AE)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA; Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Henryk Haffer (H)

Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Maximilian Muellner (M)

Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Artine Arzani (A)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Erika Chiapparelli (E)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Krizia Amoroso (K)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Jennifer Shue (J)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Roland Duculan (R)

Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Matthias Pumberger (M)

Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.

Timo Zippelius (T)

Universitätsklinikum Ulm, Klinik für Orthopädie, Oberer Eselsberg 45, 89081 Ulm, Germany.

Andrew A Sama (AA)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Frank P Cammisa (FP)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Federico P Girardi (FP)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Carol A Mancuso (CA)

Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA.

Alexander P Hughes (AP)

Spine Care Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY 10021, USA. Electronic address: hughesa@hss.edu.

Classifications MeSH