Developing an Effective Off-the-job Training Model and an Automated Evaluation System for Thoracoscopic Esophageal Atresia Surgery.
Artificial intelligence
Esophageal atresia
Minimal invasive surgery
Off-the-job training
Skill assessment
Journal
Journal of pediatric surgery
ISSN: 1531-5037
Titre abrégé: J Pediatr Surg
Pays: United States
ID NLM: 0052631
Informations de publication
Date de publication:
06 Jul 2024
06 Jul 2024
Historique:
received:
14
03
2024
revised:
13
06
2024
accepted:
28
06
2024
medline:
26
7
2024
pubmed:
26
7
2024
entrez:
25
7
2024
Statut:
aheadofprint
Résumé
Pediatric minimally invasive surgery requires advanced technical skills. Off-the-job training (OJT), especially when using disease-specific models, is an effective method of acquiring surgical skills. To achieve effective OJT, it is necessary to provide objective and appropriate skill assessment feedback to trainees. We aimed to construct a system that automatically evaluates surgical skills based on forceps movement using deep learning (DL). Using our original esophageal atresia OJT model, participants were tasked with performing esophageal anastomosis. All tasks were recorded for image analysis. Based on manual objective skill assessments, each participant's surgical skills were categorized into two groups: good and poor. The motion of the forceps in both groups was used as training data. Employing this training data, we constructed an automated system that recognized the movement of forceps and determined the quality of the surgical technique. Thirteen participants were assigned to the good skill group and 32 to the poor skill group. These cases were validated using an automated skill assessment system. This system showed a precision of 75%, a specificity of 94%, and an area under the receiver operating characteristic curve of 0.81. We constructed a system that automatically evaluated the quality of surgical techniques based on the movement of forceps using DL. Artificial intelligence diagnostics further revealed the procedures important for suture manipulation. Level IV.
Sections du résumé
BACKGROUND
BACKGROUND
Pediatric minimally invasive surgery requires advanced technical skills. Off-the-job training (OJT), especially when using disease-specific models, is an effective method of acquiring surgical skills. To achieve effective OJT, it is necessary to provide objective and appropriate skill assessment feedback to trainees. We aimed to construct a system that automatically evaluates surgical skills based on forceps movement using deep learning (DL).
METHODS
METHODS
Using our original esophageal atresia OJT model, participants were tasked with performing esophageal anastomosis. All tasks were recorded for image analysis. Based on manual objective skill assessments, each participant's surgical skills were categorized into two groups: good and poor. The motion of the forceps in both groups was used as training data. Employing this training data, we constructed an automated system that recognized the movement of forceps and determined the quality of the surgical technique.
RESULTS
RESULTS
Thirteen participants were assigned to the good skill group and 32 to the poor skill group. These cases were validated using an automated skill assessment system. This system showed a precision of 75%, a specificity of 94%, and an area under the receiver operating characteristic curve of 0.81.
CONCLUSIONS
CONCLUSIONS
We constructed a system that automatically evaluated the quality of surgical techniques based on the movement of forceps using DL. Artificial intelligence diagnostics further revealed the procedures important for suture manipulation.
LEVELS OF EVIDENCE
METHODS
Level IV.
Identifiants
pubmed: 39054116
pii: S0022-3468(24)00408-1
doi: 10.1016/j.jpedsurg.2024.06.023
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
Copyright © 2024 Elsevier Inc. All rights reserved.
Déclaration de conflit d'intérêts
Conflicts of interest None.