Continuous monitoring of surgical bimanual expertise using deep neural networks in virtual reality simulation.


Journal

NPJ digital medicine
ISSN: 2398-6352
Titre abrégé: NPJ Digit Med
Pays: England
ID NLM: 101731738

Informations de publication

Date de publication:
26 Apr 2022
Historique:
received: 23 08 2021
accepted: 29 03 2022
entrez: 27 4 2022
pubmed: 28 4 2022
medline: 28 4 2022
Statut: epublish

Résumé

In procedural-based medicine, the technical ability can be a critical determinant of patient outcomes. Psychomotor performance occurs in real-time, hence a continuous assessment is necessary to provide action-oriented feedback and error avoidance guidance. We outline a deep learning application, the Intelligent Continuous Expertise Monitoring System (ICEMS), to assess surgical bimanual performance at 0.2-s intervals. A long-short term memory network was built using neurosurgeon and student performance in 156 virtually simulated tumor resection tasks. Algorithm predictive ability was tested separately on 144 procedures by scoring the performance of neurosurgical trainees who are at different training stages. The ICEMS successfully differentiated between neurosurgeons, senior trainees, junior trainees, and students. Trainee average performance score correlated with the year of training in neurosurgery. Furthermore, coaching and risk assessment for critical metrics were demonstrated. This work presents a comprehensive technical skill monitoring system with predictive validation throughout surgical residency training, with the ability to detect errors.

Identifiants

pubmed: 35473961
doi: 10.1038/s41746-022-00596-8
pii: 10.1038/s41746-022-00596-8
pmc: PMC9042967
doi:

Types de publication

Journal Article

Langues

eng

Pagination

54

Informations de copyright

© 2022. The Author(s).

Références

JAMA Netw Open. 2019 Aug 2;2(8):e198363
pubmed: 31373651
J Neurosurg. 2017 Jul;127(1):171-181
pubmed: 27689458
J Neurosurg. 2018 Aug 3;131(1):192-200
pubmed: 30074456
Postgrad Med J. 2013 Feb;89(1048):107-10
pubmed: 23019588
JAMA Netw Open. 2020 Dec 1;3(12):e2031217
pubmed: 33369660
J Neurosurg. 2020 Apr 17;:1-2
pubmed: 32302991
N Engl J Med. 2013 Oct 10;369(15):1434-42
pubmed: 24106936
Ann Intern Med. 2015 Jan 6;162(1):W1-73
pubmed: 25560730
J Surg Educ. 2015 Jul-Aug;72(4):685-96
pubmed: 25687956
Neurosurgery. 2013 Oct;73 Suppl 1:30-8
pubmed: 24051880
Br J Surg. 2021 Jun 22;108(6):613-621
pubmed: 34157080
World Neurosurg. 2020 Jul;139:e220-e229
pubmed: 32289510
Med Educ. 2007 Dec;41(12):1178-84
pubmed: 18045370
Surg Neurol Int. 2011;2:180
pubmed: 22368786
J Surg Educ. 2018 Jan - Feb;75(1):104-115
pubmed: 28684100
Ann Surg. 2007 Nov;246(5):705-11
pubmed: 17968158
BMC Med Educ. 2021 Feb 5;21(1):91
pubmed: 33546679
Philos Trans R Soc Lond B Biol Sci. 2019 Jun 10;374(1774):20180377
pubmed: 31006369
J Surg Educ. 2016 Nov - Dec;73(6):942-953
pubmed: 27395397
Oper Neurosurg (Hagerstown). 2018 Jun 1;14(6):686-696
pubmed: 28962033
JAMA Surg. 2020 Oct 1;155(10):960-968
pubmed: 32838425
Neurosurg Focus. 2021 Aug;51(2):E15
pubmed: 34333472
Artif Intell Med. 2018 Sep;91:3-11
pubmed: 30172445
Neurosurgery. 2015 Mar;11 Suppl 2:89-98; discussion 98
pubmed: 25599201
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
J Bone Joint Surg Am. 2019 Dec 4;101(23):e127
pubmed: 31800431
World Neurosurg. 2020 Dec;144:e62-e71
pubmed: 32758649
Can J Neurol Sci. 2021 Mar;48(2):198-200
pubmed: 32907644
Oper Neurosurg (Hagerstown). 2020 Jul 1;19(1):65-75
pubmed: 31832652
Neural Comput. 1997 Nov 15;9(8):1735-80
pubmed: 9377276
World Neurosurg. 2021 May;149:e669-e686
pubmed: 33588081
Int J Comput Assist Radiol Surg. 2015 May;10(5):603-18
pubmed: 24965186
Adv Simul (Lond). 2016 Jul 25;1:25
pubmed: 29449994
Front Robot AI. 2021 Jan 20;7:586707
pubmed: 33553246
JAMA. 2013 Nov 27;310(20):2191-4
pubmed: 24141714
Surg Innov. 2015 Dec;22(6):636-42
pubmed: 25851146
PLoS One. 2020 Feb 27;15(2):e0229596
pubmed: 32106247
Artif Intell Med. 2021 Feb;112:102007
pubmed: 33581827
Br J Surg. 2004 Feb;91(2):146-50
pubmed: 14760660
JAMA Netw Open. 2022 Feb 1;5(2):e2149008
pubmed: 35191972
Nature. 2017 Sep 13;549(7671):195-202
pubmed: 28905917
Neurosurg Focus. 2010 Feb;28(2):E8
pubmed: 20121443
Am J Surg. 2013 Aug;206(2):253-62
pubmed: 23642651
J Neurosurg. 2017 Jan;126(1):71-80
pubmed: 26967787
Neurosurgery. 2012 Sep;71(1 Suppl Operative):32-42
pubmed: 22233921
PLoS Med. 2007 Oct 16;4(10):e297
pubmed: 17941715
J Surg Educ. 2019 Nov - Dec;76(6):1681-1690
pubmed: 31202633
Ann Surg. 2002 Oct;236(4):458-63; discussion 463-4
pubmed: 12368674

Auteurs

Recai Yilmaz (R)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada. recai.yilmaz@mail.com.

Alexander Winkler-Schwartz (A)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.
Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada.

Nykan Mirchi (N)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Aiden Reich (A)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Sommer Christie (S)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Dan Huy Tran (DH)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Nicole Ledwos (N)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Ali M Fazlollahi (AM)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.

Carlo Santaguida (C)

Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada.

Abdulrahman J Sabbagh (AJ)

Division of Neurosurgery, Department of Surgery, College of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia.
Clinical Skills and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia.

Khalid Bajunaid (K)

Department of Surgery, Faculty of Medicine, University of Jeddah, Jeddah, Saudi Arabia.

Rolando Del Maestro (R)

Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.
Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada.

Classifications MeSH