Enhanced Training Benefits of Video Recording Surgery With Automated Hand Motion Analysis.
Journal
World journal of surgery
ISSN: 1432-2323
Titre abrégé: World J Surg
Pays: United States
ID NLM: 7704052
Informations de publication
Date de publication:
Apr 2021
Apr 2021
Historique:
accepted:
27
11
2020
pubmed:
5
1
2021
medline:
25
6
2021
entrez:
4
1
2021
Statut:
ppublish
Résumé
Hand motion analysis by video recording during surgery has potential for evaluation of surgical performance. The aim was to identify how technical skill during open surgery can be measured unobtrusively by video recording during a surgical procedure. We hypothesized that procedural-step timing, hand movements, instrument use and Shannon entropy differ with expertise and training and are concordant with a performance-based validated individual procedure score. Surgeon and non-surgeon participants with varying training and levels of expertise were video recorded performing axillary artery exposure and control (AA) on un-preserved cadavers. Color-coded gloves permitted motion-tracking and automated extraction of entropy data from recordings. Timing and instrument-use metrics were obtained through observational video reviews. Shannon entropy measured speed, acceleration and direction by computer-vision algorithms. Findings were compared with individual procedure score for AA performance RESULTS: Experts had lowest entropy values, idle time, active time and shorter time to divide pectoralis minor, using fewer instruments. Residents improved with training, without reaching expert levels, and showed deterioration 12-18 months later. Individual procedure scores mirrored these results. Non-surgeons differed substantially. Hand motion entropy and timing metrics discriminate levels of surgical skill and training, and these findings are congruent with individual procedure score evaluations. These measures can be collected using consumer-level cameras and analyzed automatically with free software. Hand motion with video timing data may have widespread application to evaluate resident performance and can contribute to the range of evaluation and testing modalities available to educators, training course designers and surgical quality assurance programs.
Sections du résumé
BACKGROUND
BACKGROUND
Hand motion analysis by video recording during surgery has potential for evaluation of surgical performance. The aim was to identify how technical skill during open surgery can be measured unobtrusively by video recording during a surgical procedure. We hypothesized that procedural-step timing, hand movements, instrument use and Shannon entropy differ with expertise and training and are concordant with a performance-based validated individual procedure score.
METHODS
METHODS
Surgeon and non-surgeon participants with varying training and levels of expertise were video recorded performing axillary artery exposure and control (AA) on un-preserved cadavers. Color-coded gloves permitted motion-tracking and automated extraction of entropy data from recordings. Timing and instrument-use metrics were obtained through observational video reviews. Shannon entropy measured speed, acceleration and direction by computer-vision algorithms. Findings were compared with individual procedure score for AA performance RESULTS: Experts had lowest entropy values, idle time, active time and shorter time to divide pectoralis minor, using fewer instruments. Residents improved with training, without reaching expert levels, and showed deterioration 12-18 months later. Individual procedure scores mirrored these results. Non-surgeons differed substantially.
CONCLUSIONS
CONCLUSIONS
Hand motion entropy and timing metrics discriminate levels of surgical skill and training, and these findings are congruent with individual procedure score evaluations. These measures can be collected using consumer-level cameras and analyzed automatically with free software. Hand motion with video timing data may have widespread application to evaluate resident performance and can contribute to the range of evaluation and testing modalities available to educators, training course designers and surgical quality assurance programs.
Identifiants
pubmed: 33392707
doi: 10.1007/s00268-020-05916-1
pii: 10.1007/s00268-020-05916-1
pmc: PMC7920885
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
981-987Subventions
Organisme : US Army Medical Research and Materiel Command
ID : W81XWH-13-2-002
Références
Jaffer A, Bednarz B, Challacombe B et al (2009) The assessment of surgical competency in the UK. Int J Surg 7:12–15
doi: 10.1016/j.ijsu.2008.10.006
Grantcharov TP, Bardram L, Funch-Jensen P et al (2002) Assessment of technical surgical skills. Eur J Surg 168:139–144
doi: 10.1080/110241502320127739
Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278
pubmed: 9052454
pmcid: 9052454
Mayne A, Wilson L, Kennedy N (2020) The usefulness of procedure-based assessments in postgraduate surgical training within the Intercollegiate Curriculum Programme, aA scoping review. J Surg Educ (in Press). https://doi.org/10.1016/j.jsurg.2020.03.005
Mackenzie CF, Shackelford SA, Tisherman ST et al (2019) Critical errors in infrequently performed trauma procedures after training. Surgery 166:835–843
doi: 10.1016/j.surg.2019.05.031
Mackenzie CF, Garofalo E, Shackelford S et al (2015) Using an Individual Procedure Score before and after the advanced surgical skills exposure for trauma course training to benchmark a hemorrhage-control performance metric. J Surg Educ 72:278–287
doi: 10.1016/j.jsurg.2015.06.009
Mackenzie CF, Garofalo E, Puche A et al (2017) Performance of vascular exposure and fasciotomy among surgical residents before and after training compared with experts. JAMA Surg 52(6):581–588
doi: 10.1001/jamasurg.2017.0092
Mackenzie CF, Bowyer MW, Henry S et al (2018) Cadaver-based trauma procedural skills training: skills retention 30 months after training among practicing surgeons in comparison to experts and more recently trained residents. J Am Coll Surg 227:270–279
doi: 10.1016/j.jamcollsurg.2018.04.028
Birkmeyer JD, Finks JF, O’Reilly A et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442
doi: 10.1056/NEJMsa1300625
Stulberg JJ, Huang R, Kreutzer L et al (2020) Association between surgeon technical skills and patient outcomes. JAMA Surg. https://doi.org/10.1001/jamasurg.2020.3007
Gambadauro P, Margos A (2012) Surgical videos for accident analysis, performance improvement, and complication prevention: time for a surgical black box? Surg Innov 19:76–80
doi: 10.1177/1553350611415424
Alvarez-Lopez F, Maina MF, Saigí-Rubió F (2019) Use of commercial off-the-shelf devices for the detection of manual gestures in surgery: systematic literature review. J Med Internet Res 21:e11925
doi: 10.2196/11925
Ahmidi N, Poddar P, Jones JD et al (2015) Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty. Int J Comput Assist Radiol Surg 10:981–991
doi: 10.1007/s11548-015-1194-1
Datta V, Mackay S, Mandalia M et al (2001) The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 193:479–485
doi: 10.1016/S1072-7515(01)01041-9
Gray RJ, Kahol K, Islam G et al (2012) High-fidelity, low-cost, automated method to assess laparoscopic skills objectively. J Surg Educ 69:335–339
doi: 10.1016/j.jsurg.2011.10.014
Mackenzie CF, Watts D, Patel R et al (2016) Computer-assisted video hand-motion analysis of surgeon technical performance: a preliminary report of methodology and analyses. Human Factors & Ergonomic Society Proceedings, pp 72–76
Watson RA (2014) Hand motion patterns of fundamentals of laparoscopic surgery certified and noncertified surgeons. Am J Surg 207:226–230
doi: 10.1016/j.amjsurg.2013.10.007
Emura M, Tomikawa M, Kumashiro R et al (2014) Analysis of hand motion differentiates expert and novice surgeons. J Surg Res 188:8–13
doi: 10.1016/j.jss.2013.12.009
Watson RA (2012) Computer-aided feedback of surgical knot tying using optical tracking. J Surg Educ 69:306–310
doi: 10.1016/j.jsurg.2011.12.001
Watson RA (2014) Use of machine learning algorithm to classify expertise: analysis of hand motion patterns during a simulated surgical task. Acad Med 89:1163–1167
doi: 10.1097/ACM.0000000000000316
Dosis A, Aggarwal R, Bello F et al (2005) Synchronized video and motion analysis for the assessment of procedures in the operating theater. Arch Surg 140:293–299
doi: 10.1001/archsurg.140.3.293
Dosis A, Bello F, Gillies D et al (2005) Laparoscopic task recognition using Hidden Markov Models. Stud Health Technol Inform 111:115–122
pubmed: 15718711
Cao CL, Milgram P (2005) Direction and location are not sufficient for navigating in nonrigid environments: an empirical study in augmented reality. Presence Teleop Virt 16:584–602
doi: 10.1162/pres.16.6.584
Zappella L, Béjar B, Hager GD et al (2013) Surgical gesture classification from video and kinematic data. Med Image Anal 17:732–745
doi: 10.1016/j.media.2013.04.007
Bowyer MW, Kuhls DA, Haskin D et al (2013) Advanced surgical skills for exposure in trauma (ASSET): the first 25 courses. J Surg Res 183:553–558
doi: 10.1016/j.jss.2013.02.005
Mackay D (2003) Information theory, inference, and learning algorithms. Cambridge University Press, Cambridge, pp 32–34
D’Angelo AL, Rutherford DN, Ray RD et al (2015) Idle time: an underdeveloped performance metric for assessing surgical skill. Am J Surg 209:645–651
doi: 10.1016/j.amjsurg.2014.12.013
Mackenzie CF, Elster E, Bowyer MW et al (2020) Scoping evidence review on training and skills assessment for open emergency surgery. J Surg Educ 77:1211–1226
doi: 10.1016/j.jsurg.2020.02.029
Stergiou N, Harbourne R, Cavanaugh J (2006) Optimal movement variability: a new theoretical perspective for neurological physical therapy. J Neurol Phy Ther 30:120–129
doi: 10.1097/01.NPT.0000281949.48193.d9
Taylor JA, Ivry RB (2014) Cerebellar and prefrontal cortex contributions to adaptation, strategies, and reinforcement learning. Prog Brain Res 210:217–253
doi: 10.1016/B978-0-444-63356-9.00009-1
SrinivasanVB, Islam M, Zheng W (2018) Finger movement classification from myoelectric signals using convolutional. Neural Networks. Conference: 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO). https://doi.org/10.1109/ROBIO.2018.8664807
Kranzfelder M, Schneider A, Feussner H et al (2013) Shock/Sepsis/Trauma/Critical Care: real-time instrument detection in minimally invasive surgery using radiofrequency identification technology. J Surg Res 185:704–710
doi: 10.1016/j.jss.2013.06.022
Mackenzie CF, Xiao Y (2012) Video analysis: an approach for use in healthcare. In: Carayon P (ed) Handbook of human factors and ergonomics in healthcare and patient safety, 2nd edn, Chapter 31. CRC Press, Boca Raton, pp 521–534.