Machine learning allows expert level classification of intraoperative motor evoked potentials during neurosurgical procedures.

Artificial intelligence Intraoperative neuromonitoring MEP Machine learning Neurosurgery Pattern recognition

Journal

Computers in biology and medicine
ISSN: 1879-0534
Titre abrégé: Comput Biol Med
Pays: United States
ID NLM: 1250250

Informations de publication

Date de publication:
19 Aug 2024
Historique:
received: 12 01 2024
revised: 07 08 2024
accepted: 13 08 2024
medline: 21 8 2024
pubmed: 21 8 2024
entrez: 20 8 2024
Statut: aheadofprint

Résumé

To develop and evaluate machine learning (ML) approaches for muscle identification using intraoperative motor evoked potentials (MEPs), and to compare their performance to human experts. There is an unseized opportunity to apply ML analytic techniques to the world of intraoperative neuromonitoring (IOM). MEPs are the ideal candidates given the importance of their correct interpretation during a surgical operation to the brain or the spine. In this work, we develop and test a set of different ML models for muscle identification using intraoperative MEPs and compare their performance to human experts. In addition, we provide a review of the available literature on current ML applications to IOM data in neurosurgery. We trained and tested five different ML classifiers on a MEP database developed from six different muscles in patients who underwent brain or spinal cord surgery. MEPs were obtained by both transcranial (TES) and direct cortical stimulation (DCS) protocols. The models were evaluated within a single patient and on previously unseen patients, considering signals from TES and DCS both independently and mixed. Ten expert neurophysiologists classified a set of 50 randomly selected MEPs, and their performance was compared to the best performing model. A total of 25.423 MEPs were included in the study. Random Forest proved to be the best performing model with 99 % accuracy in the single patient dataset task and a 78 %-94 % accuracy range on previously unseen patients. The model performance was maximized by representing MEPs as a set of features typically employed in signal processing compared to traditional neurophysiological parameters. The classification ability of the Random Forest model between six different muscles and across different MEP acquisition modalities (79 %) significantly exceeded that of human experts (mean 48 %). Carefully selected ML models proved to have reliable capacity of extracting meaningful information to classify intraoperative MEPs using a limited number of features, proving robustness across patients and signal acquisition modalities, outperforming human experts, and with the potential to act as decision support systems to the IOM team. Such encouraging results lay the path to further explore the underlying nature of clinically important signals, with the aim to continue to produce useful applications to make surgeries safer and more efficient.

Sections du résumé

OBJECTIVE OBJECTIVE
To develop and evaluate machine learning (ML) approaches for muscle identification using intraoperative motor evoked potentials (MEPs), and to compare their performance to human experts.
BACKGROUND BACKGROUND
There is an unseized opportunity to apply ML analytic techniques to the world of intraoperative neuromonitoring (IOM). MEPs are the ideal candidates given the importance of their correct interpretation during a surgical operation to the brain or the spine. In this work, we develop and test a set of different ML models for muscle identification using intraoperative MEPs and compare their performance to human experts. In addition, we provide a review of the available literature on current ML applications to IOM data in neurosurgery.
METHODS METHODS
We trained and tested five different ML classifiers on a MEP database developed from six different muscles in patients who underwent brain or spinal cord surgery. MEPs were obtained by both transcranial (TES) and direct cortical stimulation (DCS) protocols. The models were evaluated within a single patient and on previously unseen patients, considering signals from TES and DCS both independently and mixed. Ten expert neurophysiologists classified a set of 50 randomly selected MEPs, and their performance was compared to the best performing model.
RESULTS RESULTS
A total of 25.423 MEPs were included in the study. Random Forest proved to be the best performing model with 99 % accuracy in the single patient dataset task and a 78 %-94 % accuracy range on previously unseen patients. The model performance was maximized by representing MEPs as a set of features typically employed in signal processing compared to traditional neurophysiological parameters. The classification ability of the Random Forest model between six different muscles and across different MEP acquisition modalities (79 %) significantly exceeded that of human experts (mean 48 %).
CONCLUSIONS CONCLUSIONS
Carefully selected ML models proved to have reliable capacity of extracting meaningful information to classify intraoperative MEPs using a limited number of features, proving robustness across patients and signal acquisition modalities, outperforming human experts, and with the potential to act as decision support systems to the IOM team. Such encouraging results lay the path to further explore the underlying nature of clinically important signals, with the aim to continue to produce useful applications to make surgeries safer and more efficient.

Identifiants

pubmed: 39163827
pii: S0010-4825(24)01117-X
doi: 10.1016/j.compbiomed.2024.109032
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

109032

Informations de copyright

Copyright © 2024 The Authors. Published by Elsevier Ltd.. All rights reserved.

Déclaration de conflit d'intérêts

Declaration of competing interest We declare that this manuscript is original, has not been published before and is not currently being considered for publication elsewhere. We confirm that there are no known conflicts of interest associated with this publication and there has been no significa this work that could have influenced its outcome. The manuscript has been read and approved by all named authors. The study was approved by the institutional Review Board.

Auteurs

Alessandro Boaro (A)

Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy. Electronic address: alessandro.boaro@univr.it.

Alberto Azzari (A)

Department of Computer Science, University of Verona, Verona, Italy.

Federica Basaldella (F)

Division of Neurology, University Hospital, Verona, Italy.

Sonia Nunes (S)

Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy.

Alberto Feletti (A)

Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy.

Manuele Bicego (M)

Department of Computer Science, University of Verona, Verona, Italy.

Francesco Sala (F)

Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy.

Classifications MeSH