Robotically assisted augmented reality system for identification of targeted lymph nodes in laparoscopic gynecological surgery: a first step toward the identification of sentinel node : Augmented reality in gynecological surgery.
Augmented reality
Computer-assisted surgery
Minimally invasive gynecological cancer surgery
Pelvic lymphadenectomy
Robotic endoscope holder
Journal
Surgical endoscopy
ISSN: 1432-2218
Titre abrégé: Surg Endosc
Pays: Germany
ID NLM: 8806653
Informations de publication
Date de publication:
12 2022
12 2022
Historique:
received:
27
01
2022
accepted:
19
06
2022
pubmed:
14
7
2022
medline:
16
11
2022
entrez:
13
7
2022
Statut:
ppublish
Résumé
To prove feasibility of multimodal and temporal fusion of laparoscopic images with preoperative computed tomography scans for a real-time in vivo-targeted lymph node (TLN) detection during minimally invasive pelvic lymphadenectomy and to validate and enable such guidance for safe and accurate sentinel lymph node dissection, including anatomical landmarks in an experimental model. A measurement campaign determined the most accurate tracking system (UR5-Cobot versus NDI Polaris). The subsequent interventions on two pigs consisted of an identification of artificial TLN and anatomical landmarks without and with augmented reality (AR) assistance. The AR overlay on target structures was quantitatively evaluated. The clinical relevance of our system was assessed via a questionnaire completed by experienced and trainee surgeons. An AR-based robotic assistance system that performed real-time multimodal and temporal fusion of laparoscopic images with preoperative medical images was developed and tested. It enabled the detection of TLN and their surrounding anatomical structures during pelvic lymphadenectomy. Accuracy of the CT overlay was > 90%, with overflow rates < 6%. When comparing AR to direct vision, we found that scores were significatively higher in AR for all target structures. AR aided both experienced surgeons and trainees, whether it was for TLN, ureter, or vessel identification. This computer-assisted system was reliable, safe, and accurate, and the present achievements represent a first step toward a clinical study.
Sections du résumé
BACKGROUND
To prove feasibility of multimodal and temporal fusion of laparoscopic images with preoperative computed tomography scans for a real-time in vivo-targeted lymph node (TLN) detection during minimally invasive pelvic lymphadenectomy and to validate and enable such guidance for safe and accurate sentinel lymph node dissection, including anatomical landmarks in an experimental model.
METHODS
A measurement campaign determined the most accurate tracking system (UR5-Cobot versus NDI Polaris). The subsequent interventions on two pigs consisted of an identification of artificial TLN and anatomical landmarks without and with augmented reality (AR) assistance. The AR overlay on target structures was quantitatively evaluated. The clinical relevance of our system was assessed via a questionnaire completed by experienced and trainee surgeons.
RESULTS
An AR-based robotic assistance system that performed real-time multimodal and temporal fusion of laparoscopic images with preoperative medical images was developed and tested. It enabled the detection of TLN and their surrounding anatomical structures during pelvic lymphadenectomy. Accuracy of the CT overlay was > 90%, with overflow rates < 6%. When comparing AR to direct vision, we found that scores were significatively higher in AR for all target structures. AR aided both experienced surgeons and trainees, whether it was for TLN, ureter, or vessel identification.
CONCLUSION
This computer-assisted system was reliable, safe, and accurate, and the present achievements represent a first step toward a clinical study.
Identifiants
pubmed: 35831676
doi: 10.1007/s00464-022-09409-1
pii: 10.1007/s00464-022-09409-1
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
9224-9233Informations de copyright
© 2022. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
Références
Concin N, Matias-Guiu X, Vergote I, Cibula D, Mirza MR, Marnitz S, Ledermann J, Bosse T, Chargari C, Fagotti A, Fotopoulou C, Gonzalez Martin A, Lax S, Lorusso D, Marth C, Morice P, Nout RA, O’Donnell D, Querleu D, Raspollini MR, Sehouli J, Sturdza A, Taylor A, Westermann A, Wimberger P, Colombo N, Planchamp F, Creutzberg CL (2021) ESGO/ESTRO/ESP guidelines for the management of patients with endometrial carcinoma. Int J Gynecol Cancer 31(1):12–39
doi: 10.1136/ijgc-2020-002230
pubmed: 33397713
Rozenholc A, Samouelian V, Warkus T, Gauthier P, Provencher D, Sauthier P, Gauthier F, Drakopoulos P, Cormier B (2019) Green versus blue: Randomized controlled trial comparing indocyanine green with methylene blue for sentinel lymph node detection in endometrial cancer. Gynecol Oncol 153(3):500–504
doi: 10.1016/j.ygyno.2019.03.103
pubmed: 30902369
Tucker K, Staley SA, Gehrig PA, Soper JT, Boggess JF, Ivanova A, Rossi E (2020) Defining the learning curve for successful staging with sentinel lymph node biopsy for endometrial cancer among surgeons at an academic institution. Int J Gynecol Cancer 30(3):346–351
doi: 10.1136/ijgc-2019-000942
pubmed: 31911534
Kim S, Ryu KJ, Min KJ, Lee S, Jung US, Hong JH, Song JY, Lee JK, Lee NW (2020) Learning curve for sentinel lymph node mapping in gynecologic malignancies. J Surg Oncol 121(4):599–604
doi: 10.1002/jso.25853
pubmed: 31994195
Thomaier L, Jager L, Stone R, Wethington S, Fader A, Tanner EJ (2019) Risk of empty lymph node packets in sentinel lymph node mapping for endometrial cancer using indocyanine green. Int J Gynecol Cancer 29(3):513–517
doi: 10.1136/ijgc-2019-000215
pubmed: 30833439
Geppert B, Lönnerfors C, Bollino M, Persson J (2017) Sentinel lymph node biopsy in endometrial cancer-feasibility, safety and lymphatic complications. Gynecol Oncol 148(3):491–498
doi: 10.1016/j.ygyno.2017.12.017
pubmed: 29273307
Bartoli A, Collins T, Bourdel N, Canis M (2012) Computer assisted minimally invasive surgery: is medical computer vision the answer to improving laparosurgery? Med Hypotheses 79(6):858–863
doi: 10.1016/j.mehy.2012.09.007
pubmed: 23036905
National Research Council (US) Committee for the Update of the Guide for the Care and Use of Laboratory Animals (2011) Guide for the care and use of laboratory animals (8th edn). Laboratory Animals
Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG (2010) Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol 8:e1000412
doi: 10.1371/journal.pbio.1000412
pubmed: 20613859
pmcid: 2893951
Prescott MJ, Lidster K (2017) Improving quality of science through better animal welfare: the NC3Rs strategy. Lab Anim (NY) 46:152–156
doi: 10.1038/laban.1217
R Core Team (2020) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL http://www.R-project.org/ . Accessed 2020
Bourdel N, Collins T, Pizarro D, Bartoli A, Da Ines D, Perreira B, Canis M (2017) Augmented reality in gynecologic surgery: evaluation of potential benefits for myomectomy in an experimental uterine model. Surg Endosc 31(1):456–461
doi: 10.1007/s00464-016-4932-8
pubmed: 27129565
Chauvet P, Bourdel N, Calvet L, Magnin B, Teluob G, Canis M, Bartoli A (2020) Augmented reality with diffusion tensor imaging and tractography during laparoscopic myomectomies. J Minim Invasive Gynecol 27(4):973–976
doi: 10.1016/j.jmig.2019.11.007
pubmed: 31765829
Bourdel N, Collins T, Pizarro D, Debize C, Grémeau AS, Bartoli A, Canis M (2017) Use of augmented reality in laparoscopic gynecology to visualize myomas. Fertil Steril 107(3):737–739
doi: 10.1016/j.fertnstert.2016.12.016
pubmed: 28089570
Akladios C, Gabriele V, Agnus V, Martel-Billard C, Saadeh R, Garbin O, Lecointre L, Marescaux J (2020) Augmented reality in gynecologic laparoscopic surgery: development, evaluation of accuracy and clinical relevance of a device useful to identify ureters during surgery. Surg Endosc 34(3):1077–1087
doi: 10.1007/s00464-019-06855-2
pubmed: 31161291
Togami S, Kawamura T, Yanazume S, Kamio M, Kobayashi H (2020) Comparison of lymphoscintigraphy and single photon emission computed tomography with computed tomography (SPECT/CT) for sentinel lymph node detection in endometrial cancer. Int J Gynecol Cancer Off J Int Gynecol Cancer Soc 30(5):626–630
doi: 10.1136/ijgc-2019-001154
Sahbai S, Taran F-A, Staebler A, Wallwiener D, la Fougère C, Brucker S, Dittmann H (2017) Sentinel lymph node mapping using SPECT/CT and gamma probe in endometrial cancer: an analysis of parameters affecting detection rate. Eur J Nucl Med Mol Imaging 44(9):1511–1519
doi: 10.1007/s00259-017-3692-6
pubmed: 28374119
Elisei F, Crivellaro C, Giuliani D, Dolci C, De Ponti E, Montanelli L, La Manna M, Guerra L, Arosio M, Landoni C, Buda A (2017) Sentinel-node mapping in endometrial cancer patients: comparing SPECT/CT, gamma-probe and dye. Ann Nucl Med 31(1):93–99
doi: 10.1007/s12149-016-1137-0
pubmed: 27815812
Naaman Y, Pinkas L, Roitman S, Ikher S, Oustinov N, Vaisbuch E, Yachnin A, Ben-Arie A (2016) The added value of SPECT/CT in sentinel lymph nodes mapping for endometrial carcinoma. Ann Surg Oncol 23(2):450–455
doi: 10.1245/s10434-015-4877-5
pubmed: 26438438
Cabrera S, Bebia V, Franco-Camps S, Forcada C, Villasboas-Rosciolesi D, Navales I, Pérez-Benavente A, Gil-Moreno A (2020) Technetium-99m-indocyanine green versus technetium-99m-methylene blue for sentinel lymph node biopsy in early-stage endometrial cancer. Int J Gynecol Cancer 30(3):311–317
doi: 10.1136/ijgc-2019-000923
pubmed: 31992599
Cabrera S, Barahona-Orpinell M, Almansa-González C, Padilla-Iserte P, Bebia V, Martí L, Tejerizo-García Á, Domingo S, Gil-Moreno A (2021) Combined use of ICG and technetium does not improve sentinel lymph node detection in endometrial cancer: results of the COMBITEC study. Gynecol Oncol 162(1):32–37
doi: 10.1016/j.ygyno.2021.05.002
pubmed: 33992451
Sánchez-Izquierdo N, Vidal-Sicart S, Campos F, Torné A, Angeles MA, Migliorelli F, Munmany M, Saco A, Diaz-Feijoo B, Glickman A, Ordi J, Perissinotti A, Del Pino M, Paredes P (2021) Detection of the sentinel lymph node with hybrid tracer (ICG-[99mTc]Tc-albumin nanocolloid) in intermediate- and high-risk endometrial cancer: a feasibility study. EJNMMI Res 11(1):123
doi: 10.1186/s13550-021-00863-x
pubmed: 34905122
pmcid: 8671586
KleinJan GH, Karakullukçu B, Klop WMC, Engelen T, van den Berg NS, van Leeuwen FWB (2017) Introducing navigation during melanoma-related sentinel lymph node procedures in the head-and-neck region. EJNMMI Res 7(1):65
doi: 10.1186/s13550-017-0312-1
pubmed: 28819936
pmcid: 5560283
Zhang R, Yang R, Lang Z, Wu B, Shao P, Liu P, Zhong X, Contreras CM, Xu RX (2021) Coaxial projective imaging for sentinel lymph node mapping in melanoma. JAAD Case Rep 15:46–50
doi: 10.1016/j.jdcr.2021.06.023
pubmed: 34401429
pmcid: 8355834
von Niederhäusern PA, Pezold S, Nahum U, Seppi C, Nicolas G, Rissi M, Haerle SK, Cattin PC (2019) Augmenting camera images with gamma detector data: a novel approach to support sentinel lymph node biopsy. EJNMMI Phys 6(1):10
doi: 10.1186/s40658-019-0245-z
Kavoussi LR, Moore RG, Adams JB, Partin AW (1995) Comparison o robotic versus human laparoscopic camera control. J Urol 154:2134–2136
doi: 10.1016/S0022-5347(01)66715-6
pubmed: 7500476
Franco D, Abbou CC, Fagniez PL, Bras robotisé à commande vocale pour la chirurgie endoscopique, Recommandations du CEDIT (2000) ref 00.01.
Bourdel N, Chauvet P, Calvet L, Magnin B, Bartoli A, Canis M (2019) Use of augmented reality in gynecologic surgery to visualize adenomyomas. J Minim Invasive Gynecol 26(6):1177–1180
doi: 10.1016/j.jmig.2019.04.003
pubmed: 30965117
Chauvet P, Collins T, Debize C, Novais-Gameiro L, Pereira B, Bartoli A, Canis M (2018) Augmented reality in a tumor resection model. Surg Endosc 32(3):1192–1201
doi: 10.1007/s00464-017-5791-7
pubmed: 28812157
Ward TM, Mascagni P, Madani A, Padoy N, Perretta S, Hashimoto DA (2021) Surgical data science and artificial intelligence for surgical education. J Surg Oncol 124(2):221–230
doi: 10.1002/jso.26496
pubmed: 34245578