Developing an Effective Off-the-job Training Model and an Automated Evaluation System for Thoracoscopic Esophageal Atresia Surgery.

Artificial intelligence Esophageal atresia Minimal invasive surgery Off-the-job training Skill assessment

Journal

Journal of pediatric surgery
ISSN: 1531-5037
Titre abrégé: J Pediatr Surg
Pays: United States
ID NLM: 0052631

Informations de publication

Date de publication:
06 Jul 2024
Historique:
received: 14 03 2024
revised: 13 06 2024
accepted: 28 06 2024
medline: 26 7 2024
pubmed: 26 7 2024
entrez: 25 7 2024
Statut: aheadofprint

Résumé

Pediatric minimally invasive surgery requires advanced technical skills. Off-the-job training (OJT), especially when using disease-specific models, is an effective method of acquiring surgical skills. To achieve effective OJT, it is necessary to provide objective and appropriate skill assessment feedback to trainees. We aimed to construct a system that automatically evaluates surgical skills based on forceps movement using deep learning (DL). Using our original esophageal atresia OJT model, participants were tasked with performing esophageal anastomosis. All tasks were recorded for image analysis. Based on manual objective skill assessments, each participant's surgical skills were categorized into two groups: good and poor. The motion of the forceps in both groups was used as training data. Employing this training data, we constructed an automated system that recognized the movement of forceps and determined the quality of the surgical technique. Thirteen participants were assigned to the good skill group and 32 to the poor skill group. These cases were validated using an automated skill assessment system. This system showed a precision of 75%, a specificity of 94%, and an area under the receiver operating characteristic curve of 0.81. We constructed a system that automatically evaluated the quality of surgical techniques based on the movement of forceps using DL. Artificial intelligence diagnostics further revealed the procedures important for suture manipulation. Level IV.

Sections du résumé

BACKGROUND BACKGROUND
Pediatric minimally invasive surgery requires advanced technical skills. Off-the-job training (OJT), especially when using disease-specific models, is an effective method of acquiring surgical skills. To achieve effective OJT, it is necessary to provide objective and appropriate skill assessment feedback to trainees. We aimed to construct a system that automatically evaluates surgical skills based on forceps movement using deep learning (DL).
METHODS METHODS
Using our original esophageal atresia OJT model, participants were tasked with performing esophageal anastomosis. All tasks were recorded for image analysis. Based on manual objective skill assessments, each participant's surgical skills were categorized into two groups: good and poor. The motion of the forceps in both groups was used as training data. Employing this training data, we constructed an automated system that recognized the movement of forceps and determined the quality of the surgical technique.
RESULTS RESULTS
Thirteen participants were assigned to the good skill group and 32 to the poor skill group. These cases were validated using an automated skill assessment system. This system showed a precision of 75%, a specificity of 94%, and an area under the receiver operating characteristic curve of 0.81.
CONCLUSIONS CONCLUSIONS
We constructed a system that automatically evaluated the quality of surgical techniques based on the movement of forceps using DL. Artificial intelligence diagnostics further revealed the procedures important for suture manipulation.
LEVELS OF EVIDENCE METHODS
Level IV.

Identifiants

pubmed: 39054116
pii: S0022-3468(24)00408-1
doi: 10.1016/j.jpedsurg.2024.06.023
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Informations de copyright

Copyright © 2024 Elsevier Inc. All rights reserved.

Déclaration de conflit d'intérêts

Conflicts of interest None.

Auteurs

Akihiro Yasui (A)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Yuichiro Hayashi (Y)

Graduate School of Informatics, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, Aichi, Japan.

Akinari Hinoki (A)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Hizuru Amano (H)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Chiyoe Shirota (C)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Takahisa Tainaka (T)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Wataru Sumida (W)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Satoshi Makita (S)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Yoko Kano (Y)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Aitaro Takimoto (A)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Yoichi Nakagawa (Y)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Maeda Takuya (M)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Daiki Kato (D)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Yousuke Gohda (Y)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Jiahui Liu (J)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Yaohui Guo (Y)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan.

Kensaku Mori (K)

Graduate School of Informatics, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, Aichi, Japan.

Hiroo Uchida (H)

Department of Pediatric Surgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi 466-8550, Japan. Electronic address: uchida.hiroo.f5@f.mail.nagoya-u.ac.jp.

Classifications MeSH