Augmented reality with HoloLens in parotid surgery: how to assess and to improve accuracy.
Accuracy augmented reality
Augmented reality
HoloLens
Parotid surgery
Salivary glands
Journal
European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery
ISSN: 1434-4726
Titre abrégé: Eur Arch Otorhinolaryngol
Pays: Germany
ID NLM: 9002937
Informations de publication
Date de publication:
Jul 2021
Jul 2021
Historique:
received:
26
07
2020
accepted:
31
08
2020
pubmed:
11
9
2020
medline:
2
6
2021
entrez:
10
9
2020
Statut:
ppublish
Résumé
Augmented reality improves planning and execution of surgical procedures. The aim of this study was to evaluate the feasibility of a 3D augmented reality hologram in live parotic surgery. Another goal was to develop an accuracy measuring instrument and to determine the accuracy of the system. We created a software to build and manually align 2D and 3D augmented reality models generated from MRI data onto the patient during surgery using the HoloLens The accuracy of our system was measured during real surgical procedures. Training of the experimenters and the use of fiducial markers significantly reduced the accuracy of holographic system (p = 0.0166 and p = 0.0132). Precision of the developed measuring system was very high with a mean error of the basic system of 1.3 mm. Feedback evaluation demonstrated 86% of participants agreed or strongly agreed that the HoloLens will play a role in surgical education. Furthermore, 80% of participants agreed or strongly agreed that the HoloLens is feasible to be introduced in clinical routine and will play a role within surgery in the future. The use of fiducial markers and repeated training reduces the positional error between the hologram and the real structures. The developed measuring device under the use of the Fiagon navigation system is suitable to measure accuracies of holographic augmented reality images of the HoloLens.
Identifiants
pubmed: 32910225
doi: 10.1007/s00405-020-06351-7
pii: 10.1007/s00405-020-06351-7
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
2473-2483Références
Porpiglia F, Fiori C, Checcucci E, Amparore D, Bertolo R (2018) Augmented reality robot-assisted radical prostatectomy: preliminary experience. Urology 115:184. https://doi.org/10.1016/j.urology.2018.01.028
doi: 10.1016/j.urology.2018.01.028
pubmed: 29548868
Elmi-Terander A, Nachabe R, Skulason H, Pedersen K, Söderman M, Racadio J, Babic D, Gerdhem P, Edström E (2018) Feasibility and accuracy of thoracolumbar minimally invasive pedicle screw placement with augmented reality navigation technology. Spine (Phila Pa) 43(14):1018–1023. https://doi.org/10.1097/brs.0000000000002502
doi: 10.1097/brs.0000000000002502
Bong JH, Song HJ, Oh Y, Park N, Kim H, Park S (2018) Endoscopic navigation system with extended field of view using augmented reality technology. Int J Med Robot. https://doi.org/10.1002/rcs.1886
doi: 10.1002/rcs.1886
pubmed: 29282850
Kersten-Oertel M, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE Trans Vis Comput Graph 18(2):332–352
doi: 10.1109/TVCG.2011.50
Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. IEICE TRANS Inf Syst E77-D(12):1321–1329
Scherl C, Stratemeier J, Hesser J, Schönberg S, Lammert A, Servais J, Männle D, Rotter N (2020) Augmented reality with hololens in parotid tumor surgery: a prospective feasibility study. Laryngo-Rhino-Otologie 99(S02):62. https://doi.org/10.1055/s-0040-1710872
doi: 10.1055/s-0040-1710872
Vassallo R, Rankin A, Chen ECS, Peters TM (2017) Hologram stability evaluation for Microsoft HoloLens. In: Kupinski MA, Nishikawa RM (eds) Proceedings of SPIE. Medical imaging 2017: Image perception, observer performance, and technology assessment, vol 10136. Society of Photo-Optical Instrumentation Engineers (SPIE), Bellingham, Washington, USA. https://doi.org/10.1117/12.2255831
Perkins SL, Lin MA, Srinivasan S, Wheeler AJ, Hargreaves BA, Daniel BL (2017) A mixed-reality system for breast surgical planning. In: 2017 IEEE International symposium on mixed and augmented reality (ISMAR-Adjunct), Nantes, France, 9-13 October 2017. IEEE, New York City, pp 269–274. https://doi.org/10.1109/ISMAR-Adjunct.2017.92
Unity Technologies. https://unity.com . Accessed 19 July 2020
A multi-platform, free and open source software package for visualization and medical image computing. https://www.slicer.org . Accessed 19 July 2020
Kikinis R, Pieper SD, Vosburgh KG (2014) 3D Slicer: a Platform for subject-specific image analysis, visualization, and clinical support. In: Jolesz FA (ed) Intraoperative imaging and image-guided therapy. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7657-3_19
doi: 10.1007/978-1-4614-7657-3_19
Microsoft Visual Studio. https://visualstudio.microsoft.com . Accessed 19 July 2020
Kristin J, Mucha D, Schipper J, Klenzner T (2012) Registration strategies for the application of the navigation system Fiagon at the lateral scull base. Laryngorhinootologie 91(5):306–310
doi: 10.1055/s-0031-1299755
Yoon JW, Chen RE, Kim EJ, Akinduro OO, Kerezoudis P, Han PK, Si P, Freeman WD, Diaz RJ, Komotar RJ (2018) Augmented reality for the surgeon: systematic review. Int J Med Robot Comput Assist Surgery 14(4):e1914
doi: 10.1002/rcs.1914
Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98–112
doi: 10.1016/j.compmedimag.2013.01.009
Qian L, Barthel A, Johnson A, Osgood G, Kazanzides P, Navab N, Fuerst B (2017) Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display. Int J CARS 12:901–910. https://doi.org/10.1007/s11548-017-1564-y
doi: 10.1007/s11548-017-1564-y
Barber SR, Jain S, Son Y-J, Chang EH (2018) Virtual functional endoscopic sinus surgery simulation with 3D-printed models for mixed-reality nasal endoscopy. Otolaryngol-Head Neck Surg 159(5):933–937
doi: 10.1177/0194599818797586
Li L, Yang J, Chu Y, Wu W, Xue J, Liang P, Chen L (2016) A novel augmented reality navigation system for endoscopic sinus and skull base surgery: a feasibility study. PLoS ONE 11(1):e0146996
doi: 10.1371/journal.pone.0146996
van Doormaal TP, van Doormaal JA, Mensink T (2019) Clinical accuracy of holographic navigation using point-based registration on augmented-reality glasses. Oper Neurosurg 17(6):588–593
doi: 10.1093/ons/opz094
Grimpampi E, Camomilla V, Cereatti A, De Leva P, Cappozzo A (2013) Metrics for describing soft-tissue artefact and its effect on pose, size, and shape of marker clusters. IEEE Trans Biomed Eng 61(2):362–367
doi: 10.1109/TBME.2013.2279636
Pepe A, Trotta GF, Mohr-Ziak P, Gsaxner C, Wallner J, Bevilacqua V, Egger J (2019) A marker-less registration approach for mixed reality-aided maxillofacial surgery: a pilot evaluation. J Digit Imaging 32(6):1008–1018
doi: 10.1007/s10278-019-00272-6
Barsom EZ, Graafland M, Schijven MP (2016) Systematic review on the effectiveness of augmented reality applications in medical training. Surg Endosc 30(10):4174–4183
doi: 10.1007/s00464-016-4800-6
Al Janabi HF, Aydin A, Palaneer S, Macchione N, Al-Jabir A, Khan MS, Dasgupta P, Ahmed K (2020) Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: a simulation-based feasibility study. Surg Endosc 34(3):1143–1149
doi: 10.1007/s00464-019-06862-3