A multi-view interactive virtual-physical registration method for mixed reality based surgical navigation in pelvic and acetabular fracture fixation.
Mixed reality
Orthopedic surgery
Pelvic and acetabular fracture fixation
Surgical navigation
Journal
International journal of computer assisted radiology and surgery
ISSN: 1861-6429
Titre abrégé: Int J Comput Assist Radiol Surg
Pays: Germany
ID NLM: 101499225
Informations de publication
Date de publication:
Sep 2023
Sep 2023
Historique:
received:
06
01
2023
accepted:
21
03
2023
medline:
11
9
2023
pubmed:
9
4
2023
entrez:
8
4
2023
Statut:
ppublish
Résumé
The treatment of pelvic and acetabular fractures remains technically demanding, and traditional surgical navigation systems suffer from the hand-eye mis-coordination. This paper describes a multi-view interactive virtual-physical registration method to enhance the surgeon's depth perception and a mixed reality (MR)-based surgical navigation system for pelvic and acetabular fracture fixation. First, the pelvic structure is reconstructed by segmentation in a preoperative CT scan, and an insertion path for the percutaneous LC-II screw is computed. A custom hand-held registration cube is used for virtual-physical registration. Three strategies are proposed to improve the surgeon's depth perception: vertices alignment, tremble compensation and multi-view averaging. During navigation, distance and angular deviation visual cues are updated to help the surgeon with the guide wire insertion. The methods have been integrated into an MR module in a surgical navigation system. Phantom experiments were conducted. Ablation experimental results demonstrated the effectiveness of each strategy in the virtual-physical registration method. The proposed method achieved the best accuracy in comparison with related works. For percutaneous guide wire placement, our system achieved a mean bony entry point error of 2.76 ± 1.31 mm, a mean bony exit point error of 4.13 ± 1.74 mm, and a mean angular deviation of 3.04 ± 1.22°. The proposed method can improve the virtual-physical fusion accuracy. The developed MR-based surgical navigation system has clinical application potential. Cadaver and clinical experiments will be conducted in future.
Identifiants
pubmed: 37031310
doi: 10.1007/s11548-023-02884-4
pii: 10.1007/s11548-023-02884-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1715-1724Subventions
Organisme : National Key R&D Program of China
ID : 2022YFE0197900
Organisme : National Natural Science Foundation of China
ID : 81971709
Organisme : National Natural Science Foundation of China
ID : M-0019
Organisme : National Natural Science Foundation of China
ID : 82011530141
Organisme : National Natural Science Foundation of China
ID : 82202302
Organisme : Foundation of Science and Technology Commission of Shanghai Municipality
ID : 20490740700
Organisme : Shanghai Jiao Tong University Foundation on Medical and Technological Joint Science Research
ID : YG2019ZDA06
Organisme : Shanghai Jiao Tong University Foundation on Medical and Technological Joint Science Research
ID : YG2021ZD21
Organisme : Shanghai Jiao Tong University Foundation on Medical and Technological Joint Science Research
ID : YG2021QN72
Organisme : Shanghai Jiao Tong University Foundation on Medical and Technological Joint Science Research
ID : YG2022QN056
Organisme : a Joint China-Israel grant from the Ministry of Science and Technology, Israel, 2021-2023
Organisme : SJTU Global Strategic Partnership Fund
ID : 2023 SJTU-CORNELL
Organisme : SJTU Global Strategic Partnership Fund
ID : 2021 SJTU-HUJI
Informations de copyright
© 2023. CARS.
Références
Butterwick D, Papp S, Gofton W, Liew A, Beaulé PE (2015) Acetabular fractures in the elderly: evaluation and management. J Bone Joint Surg 97(9):758–768
doi: 10.2106/JBJS.N.01037
pubmed: 25948523
Wong JML, Bewsher S, Yew J, Bucknill A, Steiger R (2015) Fluoroscopically assisted computer navigation enables accurate percutaneous screw placement for pelvic and acetabular fracture fixation. Injury 46(6):1064–1068
doi: 10.1016/j.injury.2015.01.038
pubmed: 25683211
Karkenny AJ, Mendelis JR, Geller DS, Gomez JA (2019) The role of intraoperative navigation in orthopaedic surgery. JAAOS-J Am Acad Orthopaedic Surg 27(19):e849–e858
doi: 10.5435/JAAOS-D-18-00478
Lungu AJ, Swinkels W, Claesen L, Tu P, Egger J, Chen X (2021) A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery. Expert Rev Med Devices 18(1):47–62
doi: 10.1080/17434440.2021.1860750
pubmed: 33283563
Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X, Egger J (2015) Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform 55:124–131
doi: 10.1016/j.jbi.2015.04.003
pubmed: 25882923
Liebmann F, Roner S, Atzigen M, Scaramuzza D, Sutter R, Snedeker J, Fürnstahl P (2019) Pedicle screw navigation using surface digitization on the Microsoft HoloLens. Int J Comp Assist Radiol Surg 14(7):1157–1165.
Gsaxner C, Pepe A, Li J, Ibrahimpasic U, Wallner J, Schmalstieg D, Egger J (2021) Augmented reality for head and neck carcinoma imaging: Description and feasibility of an instant calibration, markerless approach. Comput Methods Programs Biomed 200:105854
doi: 10.1016/j.cmpb.2020.105854
pubmed: 33261944
Atzigen M, Liebmann F, Hoch A, Spirig JM, Farshad M, Snedeker J, Fürnstahl P (2022) Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion. Med Image Anal 77:102365
doi: 10.1016/j.media.2022.102365
Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J (2019) Markerless image-to-face registration for untethered augmented reality in head and neck surgery. In: Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, pp 236–244.
Sun Q, Mai Y, Yang R, Ji T, Jiang X, Chen X (2020) Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens. Int J Comp Assist Radiol Surg 15(11):1907–1919.
Li R, Tong Y, Yang T, Guo J, Si W, Zhang Y, Heng PA (2021) Towards quantitative and intuitive percutaneous tumor puncture via augmented virtual reality. Comput Med Imaging Graph 90:101905
doi: 10.1016/j.compmedimag.2021.101905
pubmed: 33848757
Song T, Yang C, Dianat O, Azimi E (2018) Endodontic guided treatment using augmented reality on a head-mounted display system. Healthcare Technol Lett 5(5):201–207
doi: 10.1049/htl.2018.5062
Tu P, Qin C, Guo Y, Li D, Lungu AJ, Wang H, Chen X (2022) Ultrasound image guided and mixed reality-based surgical system with real-time soft tissue deformation computing for robotic cervical pedicle screw placement. IEEE Trans Biomed Eng 68(8):2593–2603
doi: 10.1109/TBME.2022.3150952
Oliveira ME, Debarba HG, Lädermann A, Chagué S, Charbonnier C (2019) A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery. Int J Med Robot Computer Assisted Surg 15(2):e1969.
Fotouhi J, Mehrfard A, Song T, Johnson A, Osgood G, Unberath M, Navab N (2020) Development and pre-clinical analysis of spatiotemporal-aware augmented reality in orthopedic interventions. IEEE Trans Med Imaging 40(2):765–778
doi: 10.1109/TMI.2020.3037013
Scherer J, Guy P, Lefaivre KA, Pape HC, Werner CM, Osterhoff G (2017) Guide wire insertion for percutaneous LC2 screws in acetabular and pelvic ring fixation using a transpedicular working cannula. Injury 48(10):2360–2364
doi: 10.1016/j.injury.2017.08.049
pubmed: 28859845
Wang H, Wang F, Newman S, Lin Y, Chen X, Xu L, Wang Q (2016) Application of an innovative computerized virtual planning system in acetabular fracture surgery: a feasibility study. Injury 47(8):1698–1701
doi: 10.1016/j.injury.2016.05.006
pubmed: 27238885
Tu P, Gao Y, Lungu AJ, Li D, Wang H, Chen X (2021) Augmented reality based navigation for distal interlocking of intramedullary nails utilizing Microsoft HoloLens 2. Comput Biol Med 133:104402
doi: 10.1016/j.compbiomed.2021.104402
pubmed: 33895460
Lane CG, Warren R, Pearle AD (2008) The pivot shift. JAAOS-J Am Acad Orthopaed Surgeons 16(12):679–688
doi: 10.5435/00124635-200812000-00001
Moakher M (2002) Means and averaging in the group of rotations. SIAM J Matrix Anal Appl 24(1):1–16
doi: 10.1137/S0895479801383877
Gao Y, Wang H, Tu P, Hu J, Wang Q, Chen X (2021) A novel dynamic electromagnetic tracking navigation system for distal locking of intramedullary nails. Comput Methods Programs Biomed 209:106326
doi: 10.1016/j.cmpb.2021.106326
pubmed: 34433127
Qin C, Cao Z, Fan S, Wu Y, Sun Y, Politis C, Chen X (2019) An oral and maxillofacial navigation system for implant placement with automatic identification of fiducial points. Int J Comp Assist Radiol Surg 14(2):281–289.
Fan X, Zhu Q, Tu P, Joskowicz L, Chen X (2022) A review of advances in image-guided orthopedic surgery. Phys Med Biolo 68:02TR01.