Eye-tracking in surgery: a systematic review.
eye-tracking
gaze-tracking
surgery
surgical innovation
surgical training
Journal
ANZ journal of surgery
ISSN: 1445-2197
Titre abrégé: ANZ J Surg
Pays: Australia
ID NLM: 101086634
Informations de publication
Date de publication:
11 2023
11 2023
Historique:
revised:
20
08
2023
received:
11
04
2023
accepted:
22
08
2023
medline:
29
11
2023
pubmed:
5
9
2023
entrez:
5
9
2023
Statut:
ppublish
Résumé
Surgery is constantly evolving with the assistance of rapidly developing novel technology. Eye-tracking devices provide opportunities to monitor the acquisition of surgical skills, gain insight into performance, and enhance surgical practice. The aim of this review was to consolidate the available evidence for the use of eye-tracking in the surgical disciplines. A systematic literature review was conducted in accordance with PRISMA guidelines. A search of OVID Medline, EMBASE, Cochrane library, Scopus, and Science Direct was conducted January 2000 until December 2022. Studies involving eye-tracking in surgical training, assessment and technical innovation were included in the review. Non-surgical procedures, animal studies, and studies not involving surgical participants were excluded from the review. The search returned a total of 12 054 articles, 80 of which were included in the final analysis and review. Seventeen studies involved eye-tracking in surgical training, 48 surgical assessment, and 20 were focussing on technical aspects of this technology. Twenty-six different eye-tracking devices were used in the included studies. Metrics such as the number of fixations, duration of fixations, dwell time, and cognitive workload were able to differentiate between novice and expert performance. Eight studies demonstrated the effectiveness of gaze-training for improving surgical skill. The current literature shows a broad range of utility for a variety of eye-tracking devices in surgery. There remains a lack of standardization for metric parameters and gaze analysis techniques. Further research is required to validate its use to establish reliability and create uniform practices.
Sections du résumé
BACKGROUND
Surgery is constantly evolving with the assistance of rapidly developing novel technology. Eye-tracking devices provide opportunities to monitor the acquisition of surgical skills, gain insight into performance, and enhance surgical practice. The aim of this review was to consolidate the available evidence for the use of eye-tracking in the surgical disciplines.
METHODS
A systematic literature review was conducted in accordance with PRISMA guidelines. A search of OVID Medline, EMBASE, Cochrane library, Scopus, and Science Direct was conducted January 2000 until December 2022. Studies involving eye-tracking in surgical training, assessment and technical innovation were included in the review. Non-surgical procedures, animal studies, and studies not involving surgical participants were excluded from the review.
RESULTS
The search returned a total of 12 054 articles, 80 of which were included in the final analysis and review. Seventeen studies involved eye-tracking in surgical training, 48 surgical assessment, and 20 were focussing on technical aspects of this technology. Twenty-six different eye-tracking devices were used in the included studies. Metrics such as the number of fixations, duration of fixations, dwell time, and cognitive workload were able to differentiate between novice and expert performance. Eight studies demonstrated the effectiveness of gaze-training for improving surgical skill.
CONCLUSION
The current literature shows a broad range of utility for a variety of eye-tracking devices in surgery. There remains a lack of standardization for metric parameters and gaze analysis techniques. Further research is required to validate its use to establish reliability and create uniform practices.
Types de publication
Systematic Review
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
2600-2608Informations de copyright
© 2023 The Authors. ANZ Journal of Surgery published by John Wiley & Sons Australia, Ltd on behalf of Royal Australasian College of Surgeons.
Références
Kerr RS. Surgery in the 2020s: implications of advancing technology for patients and the workforce. Future Healthc J. 2020; 7: 46-49.
Khor WS, Baker B, Amin K, Chan A, Patel K, Wong J. Augmented and virtual reality in surgery-the digital surgical environment: applications, limitations and legal pitfalls. Ann. Transl. Med. 2016; 4: 454.
Tonutti M, Elson DS, Yang G-Z, Darzi AW, Sodergren MH. The role of technology in minimally invasive surgery: state of the art, recent developments and future directions. Postgrad. Med. J. 2017; 93: 159-167.
Bolton W, Ng S, Kinch J et al. The role of medical technology in surgical innovation. Bull. Royal Coll. Surg. Engl. 2019; 101: 24-27.
Vles M, Terng N, Zijlstra K, Mureau M, Corten E. Virtual and augmented reality for preoperative planning in plastic surgical procedures: a systematic review. J. Plast. Reconstr. Aesthet. Surg. 2020; 73: 1951-1959.
Knight S, Ots R, Maimbo M, Drake T, Fairfield C, Harrison E. Systematic review of the use of big data to improve surgery in low-and middle-income countries. J Br Surg. 2019; 106: e62-e72.
Shaharan S, Neary P. Evaluation of surgical training in the era of simulation. World J. Gastrointest. Endosc. 2014; 6: 436-447.
Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge D, Fried GM. Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. J. Am. Coll. Surg. 2004; 198: 105-110.
Hróbjartsson A, Thomsen AS, Emanuelsson F et al. Observer bias in randomized clinical trials with measurement scale outcomes: a systematic review of trials with both blinded and nonblinded assessors. CMAJ. 2013; 185: E201-E211.
Gerull KM, Loe M, Seiler K, McAllister J, Salles A. Assessing gender bias in qualitative evaluations of surgical residents. Am. J. Surg. 2019; 217: 306-313.
Hussain Z. Adopting new technology is crucial to surgeons' training, says report. BMJ 2022; 378: o1989.
Moorthy K, Munz Y, Dosis A, Bello F, Chang A, Darzi A. Bimodal assessment of laparoscopic suturing skills: construct and concurrent validity. Surg. Endosc. 2004; 18: 1608-1612.
Oostema JA, Abdel MP, Gould JC. Time-efficient laparoscopic skills assessment using an augmented-reality simulator. Surg. Endosc. 2008; 22: 2621-2624.
Vine SJ, Wilson MR. The influence of quiet eye training and pressure on attention and visuo-motor control. Acta Psychol. (Amst) 2011; 136: 340-346.
Borowsky A, Oron-Gilad T, Meir A, Parmet Y. Drivers' perception of vulnerable road users: a hazard perception approach. Accid. Anal. Prev. 2012; 44: 160-166.
Bowling SR, Khasawneh MT, Kaewkuekool S, Jiang X, Gramopadhye AK. Evaluating the effects of virtual training in an aircraft maintenance task. Int. J. Aviat. Psychol. 2008; 18: 104-116.
Zheng B, Jiang X, Atkins MS. Detection of changes in surgical difficulty. Surg. Innov. 2015; 22: 629-635.
Sodergren MH, Orihuela-Espina F, Froghi F et al. Value of orientation training in laparoscopic cholecystectomy. Br. J. Surg. 2011; 98: 1437-1445.
Dilley J, Singh H, Pratt P, Omar I, Darzi A, Mayer E. Visual behaviour in robotic surgery - demonstrating the validity of the simulated environment. Int. J. Med. Robotics Comput. Assist. Surg. 2020; 16: e2075.
Ahmidi N, Hager GD, Ishii L, Fichtinger G, Gallia GL, Ishii M. Surgical task and skill classification from eye tracking and tool motion in minimally invasive surgery. Med. Image Comput. Comput. Assist. Interv. 2010; 13: 295-302.
Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang G-Z, Darzi A. Eye tracking for skills assessment and training: a systematic review. J. Surg. Res. 2014; 191: 169-178.
Ashraf H, Sodergren MH, Merali N, Mylonas G, Singh H, Darzi A. Eye-tracking technology in medical education: a systematic review. Med. Teach. 2018; 40: 62-69.
Merali N, Veeramootoo D, Singh S. Eye-tracking Technology in Surgical Training. J. Invest. Surg. 2019; 32: 587-593.
Valles J, Zhang T, McIntosh P, Pacilli M, Nataraja RM. Assessment of Core surgical skills using a mixed reality headset - the MoTOR study. J. Med. Syst. 2022; 46: 102.
Kulkarni CS, Deng S, Wang T et al. Scene-dependent, feedforward eye gaze metrics can differentiate technical skill levels of trainees in laparoscopic surgery. Surg. Endosc. 2022; 37: 1569-1580.
Fichtel E, Lau N, Park J et al. Eye tracking in surgical education: gaze-based dynamic area of interest can discriminate adverse events and expertise. Surg. Endosc. 2018; 33: 2249-2256.
Sodergren MH, Orihuela-Espina F, Clark J, Darzi A, Yang G-Z. A hidden markov model-based analysis framework using eye-tracking data to characterise re-orientation strategies in minimally invasive surgery. Cogn. Process. 2010; 11: 275-283.
Khakhar R, You F, Chakkalakal D, Dobbelstein D, Picht T. Hands-free adjustment of the microscope in microneurosurgery. World Neurosurg. 2021; 148: e155-e163.
Eivazi S, Bednarik R, Leinonen V, Mvuz F, Jaaskelainen JE. Embedding an eye tracker into a surgical microscope: requirements, design, and implementation. IEEE Sens. J. 2016; 16: 2070-2078.
Mylonas GP, Kwok K-W, James DRC et al. Gaze-contingent motor channelling, haptic constraints and associated cognitive demand for robotic MIS. Med. Image Anal. 2012; 16: 612-631.
Causer J, Harvey A, Snelgrove R, Arsenault G, Vickers JN. Quiet eye training improves surgical knot tying more than traditional technical training: a randomized controlled study. Am. J. Surg. 2014; 208: 171-177.
Harvey A, Vickers JN, Snelgrove R, Scott MF, Morrison S. Expert surgeon's quiet eye and slowing down: expertise differences in performance and quiet eye duration during identification and dissection of the recurrent laryngeal nerve. Am. J. Surg. 2014; 207: 187-193.
Wilson MR, McGrath JS, Vine SJ, Brewer J, Defriend D, Masters RSW. Perceptual impairment and psychomotor control in virtual laparoscopic surgery. Surg. Endosc. 2011; 25: 2268-2274.
Sánchez-Ferrer ML, Grima-Murcia MD, Sánchez-Ferrer F, Hernández-Peñalver AI, Fernández-Jover E, Campo FS. Use of eye tracking as an innovative instructional method in surgical human anatomy. J. Surg. Educ. 2017; 74: 668-673.
Zheng B, Wang X, Zheng Y, Feng J. 3D-printed model improves clinical assessment of surgeons on anatomy. J. Robotic Surg. 2019; 13: 61-67.
An VVG, Mirza Y, Mazomenos E, Vasconcelos F, Stoyanov D, Oussedik S. Arthroscopic simulation using a knee model can be used to train speed and gaze strategies in knee arthroscopy. Knee 2018; 25: 1214-1221.
Sodergren MH, Orihuela-Espina F, Clark J, Teare J, Yang G-Z, Darzi A. Evaluation of orientation strategies in laparoscopic cholecystectomy. Ann. Surg. 2010; 252: 1027-1036.
Ji Y, Kong Z, Deng Y, Chen J, Liu Y, Zhao L. The role of eye tracker in teaching video-assisted thoracoscopic surgery: the differences in visual strategies between novice and expert surgeons in thoracoscopic surgery. Ann. Transl. Med. 2022; 10: 592.
Vine SJ, Chaytor RJ, McGrath JS, Masters RSW, Wilson MR. Gaze training improves the retention and transfer of laparoscopic technical skills in novices. Surg. Endosc. 2013; 27: 3205-3213.
Vine SJ, Masters RSW, McGrath JS, Bright E, Wilson MR. Cheating experience: guiding novices to adopt the gaze strategies of experts expedites the learning of technical laparoscopic skills. Surgery 2012; 152: 32-40.
Wilson MR, Vine SJ, Bright E, Masters RSW, Defriend D, McGrath JS. Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: a randomized, controlled study. Surg. Endosc. 2011; 25: 3731-3739.
Wu C, Cha J, Sulek J et al. Eye-tracking metrics predict perceived workload in robotic surgical skills training. Hum. Factors J. Hum. Factors Ergonomics Soc. 2019; 62: 1365-1386.
Eivazi S, Hafez A, Fuhl W et al. Optimal eye movement strategies: a comparison of neurosurgeons gaze patterns when using a surgical microscope. Acta Neurochir. 2017; 159: 959-966.
Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang G-Z, Darzi A. Differences in gaze behaviour of expert and junior surgeons performing open inguinal hernia repair. Surg. Endosc. 2014; 29: 405-413.
Vine SJ, McGrath JS, Bright E, Dutton T, Clark J, Wilson MR. Assessing visual control during simulated and live operations: gathering evidence for the content validity of simulation using eye movement metrics. Surg. Endosc. 2014; 28: 1788-1793.
Tien G, Zheng B, Atkins MS. Quantifying surgeons' vigilance during laparoscopic operations using eyegaze tracking. Stud. Health Technol. 2011; 163: 658-662.
Moore LJ, Wilson MR, McGrath JS, Waine E, Masters RSW, Vine SJ. Surgeons' display reduced mental effort and workload while performing robotically assisted surgical tasks, when compared to conventional laparoscopy. Surg. Endosc. 2014; 29: 2553-2560.
Khan RSA, Tien G, Atkins MS, Zheng B, Panton ONM, Meneghetti AT. Analysis of eye gaze: do novice surgeons look at the same location as expert surgeons during a laparoscopic operation? Surg. Endosc. 2012; 26: 3536-3540.
Kottayil NK, Bogdanova R, Cheng I, Zheng B, Basu A, Kottayil NK, et al. Investigation of gaze patterns in multi view laparoscopic surgery. 2016 38th Annu Int. Conf. IEEE Eng. Med. Biol. Soc. Embc. 2016:4031-4034.
Wilson M, McGrath J, Vine S, Brewer J, Defriend D, Masters R. Psychomotor control in a virtual laparoscopic surgery training environment: gaze control parameters differentiate novices from experts. Surg. Endosc. 2010; 24: 2458-2464.
Zheng B, Tien G, Atkins SM et al. Surgeon's vigilance in the operating room. Am. J. Surg. 2011; 201: 673-677.
Erridge S, Ashraf H, Purkayastha S, Darzi A, Sodergren MH. Comparison of gaze behaviour of trainee and experienced surgeons during laparoscopic gastric bypass. Br. J. Surg. 2017; 105: 287-294.
Dalveren GGM, Cagiltay NE, Ozcelik E, Maras H. Insights from pupil size to mental workload of surgical residents: feasibility of an educational computer-based surgical simulation environment (ECE) considering the hand condition. Surg. Innov. 2018; 25: 616-624.
Gao J, Liu S, Feng Q et al. Subjective and objective quantification of the effect of distraction on physician's workload and performance during simulated laparoscopic surgery. Med. Sci. Monitor. 2019; 25: 3127-3132.
Gunawardena N, Matscheko M, Anzengruber B, Ferscha A, Schobesberger M, Shamiyeh A, et al. The effect of expertise on gaze behaviour in laparoscopic cholecystectomy. 2019 41st Annu. Int. Conf IEEE Eng. Med. Biol. Soc. Embc. 2019:7123-7127.
Jiang X, Zheng B, Tien G, Atkins MS. Pupil response to precision in surgical task execution. Stud. Health Technol. 2013; 184: 210-214.
Omurtag A, Roy R, Dehais F, Chatty L, Garbey M. Tracking mental workload by multimodal measurements in the operating room. In: Ayaz H, Dehais F, editors. Neuroergonomics. Cambridge, MA: Academic Press; 2019, pp. 99-103.
Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR. Eye metrics as an objective assessment of surgical skill. Ann. Surg. 2010; 252: 177-182.
Zhang J-Y, Liu S-L, Feng Q-M, Gao J-Q, Zhang Q. Correlative evaluation of mental and physical workload of laparoscopic surgeons based on surface electromyography and eye-tracking signals. Sci. Rep. 2017; 7: 11095.
Diaz-Piedra C, Sanchez-Carrion JM, Rieiro H, Stasi LLD. Gaze-based technology as a tool for surgical skills assessment and training in urology. Urology 2017; 107: 26-30.
Stasi LLD, Díaz-Piedra C, Ruiz-Rabelo JF, Rieiro H, Carrion JMS, Catena A. Quantifying the cognitive cost of laparo-endoscopic single-site surgeries: gaze-based indices. Appl. Ergon. 2017; 65: 168-174.
Dalveren GGM, Cagiltay NE. Using eye-movement events to determine the mental workload of surgical residents. J. Eye Movement Res. 2018; 11(4).
Açık A, Barkana DE, Akgün G, Yantaç AE, Aydın Ç. Evaluation of a surgical interface for robotic cryoablation task using an eye-tracking system. Int. J. Human-Comput. Stud. 2016; 95: 39-53.
Sivananthan A, Kogkas A, Glover B, Darzi A, Mylonas G, Patel N. A novel gaze-controlled flexible robotized endoscope; preliminary trial and report. Surg. Endosc. 2021; 35: 4890-4899.
Ahmidi N, Ishii M, Fichtinger G, Gallia GL, Hager GD. An objective and automated method for assessing surgical skill in endoscopic sinus surgery using eye-tracking and tool-motion data. Int. Forum Allergy Rh. 2012; 2: 507-515.
James A, Vieira D, Lo B, Darzi A, Yang GZ. Medical image computing and computer-assisted intervention - MICCAI 2007, 10th international conference, Brisbane, Australia, October 29 - November 2, 2007. Proc. Part II. Lect. Notes Comput Sc. 2007; 10: 110-117.
Clancy NT, Mylonas GP, Yang G-Z, Elson DS. Gaze-contingent autofocus system for robotic-assisted minimally invasive surgery. 2011 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2011:5396-5399.
Kogkas AA, Darzi A, Mylonas GP. Gaze-contingent perceptually enabled interactions in the operating theatre. Int. J. Comput. Assist. Radiol. Surg. 2017; 12: 1131-1140.
Mylonas G, Darzi A, Yang G-Z. Gaze contingent depth recovery and motion stabilisation for minimally invasive robotic Surgery, 2004. 311-319.
Hellum O, Mu Y, Kersten-Oertel M, Xiao Y. A novel prototype for virtual-reality-based deep brain stimulation trajectory planning using voodoo doll annotation and eye-tracking. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 2022; 10: 418-424.
Moore LJ, Vine SJ, Cooke A, Ring C, Wilson MR. Quiet eye training expedites motor learning and aids performance under heightened anxiety: the roles of response programming and external attention. Psychophysiology 2012; 49: 1005-1015.
Williams AM, Singer RN, Frehlich SG. Quiet eye duration, expertise, and task complexity in near and far aiming tasks. J. Motor Behav. 2002; 34: 197-207.
Chetwood ASA, Kwok K-W, Sun L-W et al. Collaborative eye tracking: a potential training tool in laparoscopic surgery. Surg. Endosc. 2012; 26: 2003-2009.
Kwok K-W, Sun L-W, Mylonas GP, James DRC, Orihuela-Espina F, Yang G-Z. Collaborative gaze channelling for improved cooperation during robotic assisted surgery. Ann. Biomed. Eng. 2012; 40: 2156-2167.
Leff DR, James DRC, Orihuela-Espina F et al. The impact of expert visual guidance on trainee visual search strategy, visual attention and motor skills. Front. Hum. Neurosci. 2015; 9: 526.
Neggers SFW, Bekkering H. Ocular gaze is anchored to the target of an ongoing pointing movement. J. Neurophysiol. 2000; 83: 639-651.
Sarlegna F, Blouin J, Bresciani J-P, Bourdin C, Vercher J-L, Gauthier GM. Target and hand position information in the online control of goal-directed arm movements. Exp. Brain Res. 2003; 151: 524-535.
Sailer U, Flanagan JR, Johansson RS. Eye-hand coordination during learning of a novel visuomotor task. J. Neurosci. 2005; 25: 8833-8842.
Bright E, Vine SJ, Dutton T, Wilson MR, McGrath JS. Visual control strategies of surgeons: a novel method of establishing the construct validity of a transurethral resection of the prostate surgical simulator. J. Surg. Educ. 2014; 71: 434-439.
Beatty J. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 1982; 91: 276-292.
Marshall SP. The index of cognitive activity: measuring cognitive workload. Proc Ieee 7th Conf hum factors power plants. 2002:1-5.
Duchowski A, Krejtz K, Krejtz I, et al. The index of pupillary activity: measuring cognitive load vis-à-vis task difficulty with pupil oscillation, 2018. 1-13 p.
Lam K, Abràmoff MD, Balibrea JM et al. A Delphi consensus statement for digital surgery. NPJ Dig. Med. 2022; 5: 100.
Berges AJ, Vedula SS, Chara A, Hager GD, Ishii M, Malpani A. Eye tracking and motion data predict endoscopic sinus surgery skill. Laryngoscope 2022; 133: 500-505.