Automated Methods of Technical Skill Assessment in Surgery: A Systematic Review.

Automated methods Interpersonal and Communication Skills Medical Knowledge Patient Care Practice-Based Learning and Improvement Surgical technology Surgical training Systems-Based Practice Technical skills

Journal

Journal of surgical education
ISSN: 1878-7452
Titre abrégé: J Surg Educ
Pays: United States
ID NLM: 101303204

Informations de publication

Date de publication:
Historique:
received: 27 02 2019
revised: 04 06 2019
accepted: 14 06 2019
pubmed: 6 7 2019
medline: 21 10 2020
entrez: 6 7 2019
Statut: ppublish

Résumé

The goal of the current study is to systematically review the literature addressing the use of automated methods to evaluate technical skills in surgery. The classic apprenticeship model of surgical training includes subjective assessments of technical skill. However, automated methods to evaluate surgical technical skill have been recently studied. These automated methods are a more objective, versatile, and analytical way to evaluate a surgical trainee's technical skill. A literature search of the Ovid Medline, Web of Science, and EMBASE Classic databases was performed. Articles evaluating automated methods for surgical technical skill assessment were abstracted. The quality of all included studies was assessed using the Medical Education Research Study Quality Instrument. A total of 1715 articles were identified, 76 of which were selected for final analysis. An automated methods pathway was defined that included kinetics and computer vision data extraction methods. Automated methods included tool motion tracking, hand motion tracking, eye motion tracking, and muscle contraction analysis. Finally, machine learning, deep learning, and performance classification were used to analyse these methods. These methods of surgical skill assessment were used in the operating room and simulated environments. The average Medical Education Research Study Quality Instrument score across all studies was 10.86 (maximum score of 18). Automated methods for technical skill assessment is a growing field in surgical education. We found quality studies evaluating these techniques across many environments and surgeries. More research must be done to ensure these techniques are further verified and implemented in surgical curricula.

Sections du résumé

OBJECTIVE OBJECTIVE
The goal of the current study is to systematically review the literature addressing the use of automated methods to evaluate technical skills in surgery.
BACKGROUND BACKGROUND
The classic apprenticeship model of surgical training includes subjective assessments of technical skill. However, automated methods to evaluate surgical technical skill have been recently studied. These automated methods are a more objective, versatile, and analytical way to evaluate a surgical trainee's technical skill.
STUDY DESIGN METHODS
A literature search of the Ovid Medline, Web of Science, and EMBASE Classic databases was performed. Articles evaluating automated methods for surgical technical skill assessment were abstracted. The quality of all included studies was assessed using the Medical Education Research Study Quality Instrument.
RESULTS RESULTS
A total of 1715 articles were identified, 76 of which were selected for final analysis. An automated methods pathway was defined that included kinetics and computer vision data extraction methods. Automated methods included tool motion tracking, hand motion tracking, eye motion tracking, and muscle contraction analysis. Finally, machine learning, deep learning, and performance classification were used to analyse these methods. These methods of surgical skill assessment were used in the operating room and simulated environments. The average Medical Education Research Study Quality Instrument score across all studies was 10.86 (maximum score of 18).
CONCLUSIONS CONCLUSIONS
Automated methods for technical skill assessment is a growing field in surgical education. We found quality studies evaluating these techniques across many environments and surgeries. More research must be done to ensure these techniques are further verified and implemented in surgical curricula.

Identifiants

pubmed: 31272846
pii: S1931-7204(19)30164-3
doi: 10.1016/j.jsurg.2019.06.011
pii:
doi:

Types de publication

Journal Article Systematic Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

1629-1639

Informations de copyright

Copyright © 2019 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Auteurs

Marc Levin (M)

Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada. Electronic address: marc.levin@medportal.ca.

Tyler McKechnie (T)

Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada.

Shuja Khalid (S)

Surgical Safety Technologies, Li Ka Shing International Knowledge Institute, Toronto, Ontario, Canada.

Teodor P Grantcharov (TP)

Surgical Safety Technologies, Li Ka Shing International Knowledge Institute, Toronto, Ontario, Canada; Department of Surgery, University of Toronto, Toronto, Ontario, Canada.

Mitchell Goldenberg (M)

Surgical Safety Technologies, Li Ka Shing International Knowledge Institute, Toronto, Ontario, Canada; Department of Surgery, University of Toronto, Toronto, Ontario, Canada.

Articles similaires

How Certification Exams Reflect Current Practice.

Tara L Myers, Sean DeGarmo, Marianne Horahan
1.00
Humans Certification Clinical Competence Education, Nursing, Continuing Adult
Humans Robotic Surgical Procedures Clinical Competence Male Female
Humans Robotic Surgical Procedures Prostatectomy Learning Curve Male
Humans Education, Nursing, Baccalaureate Students, Nursing Geriatric Nursing Health Knowledge, Attitudes, Practice

Classifications MeSH