CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording.

HoloLens 2 augmented reality ultrasound training

Journal

Journal of imaging
ISSN: 2313-433X
Titre abrégé: J Imaging
Pays: Switzerland
ID NLM: 101698819

Informations de publication

Date de publication:
29 Dec 2022
Historique:
received: 30 09 2022
revised: 30 11 2022
accepted: 20 12 2022
entrez: 20 1 2023
pubmed: 21 1 2023
medline: 21 1 2023
Statut: epublish

Résumé

Obstetric ultrasound (US) training teaches the relationship between foetal anatomy and the viewed US slice to enable navigation to standardised anatomical planes (head, abdomen and femur) where diagnostic measurements are taken. This process is difficult to learn, and results in considerable inter-operator variability. We propose the CAL-Tutor system for US training based on a US scanner and phantom, where a model of both the baby and the US slice are displayed to the trainee in its physical location using the HoloLens 2. The intention is that AR guidance will shorten the learning curve for US trainees and improve spatial awareness. In addition to the AR guidance, we also record many data streams to assess user motion and the learning process. The HoloLens 2 provides eye gaze, head and hand position, ARToolkit and NDI Aurora tracking gives the US probe positions and an external camera records the overall scene. These data can provide a rich source for further analysis, such as distinguishing expert from novice motion. We have demonstrated the system in a sample of engineers. Feedback suggests that the system helps novice users navigate the US probe to the standard plane. The data capture is successful and initial data visualisations show that meaningful information about user behaviour can be captured. Initial feedback is encouraging and shows improved user assessment where AR guidance is provided.

Identifiants

pubmed: 36662104
pii: jimaging9010006
doi: 10.3390/jimaging9010006
pmc: PMC9860994
pii:
doi:

Types de publication

Journal Article

Langues

eng

Subventions

Organisme : Wellcome Trust
Pays : United Kingdom

Références

Eur Radiol Exp. 2020 Feb 4;4(1):7
pubmed: 32020366
Int J Comput Assist Radiol Surg. 2022 Aug;17(8):1437-1444
pubmed: 35556206
Am J Surg. 2016 Jan;211(1):40-5
pubmed: 26323998
IEEE Trans Biomed Eng. 2020 Feb;67(2):411-419
pubmed: 31059421
Med Image Anal. 2020 Oct;65:101762
pubmed: 32623278
Healthc Technol Lett. 2018 Sep 17;5(5):194-200
pubmed: 30800322
J Imaging. 2022 Nov 09;8(11):
pubmed: 36354878
J Cardiothorac Vasc Anesth. 2018 Jun;32(3):1363-1367
pubmed: 29452879
IEEE Trans Cybern. 2017 Jun;47(6):1576-1586
pubmed: 28371793
Med Image Anal. 2022 Apr;77:102361
pubmed: 35168103
Ultrasound Obstet Gynecol. 2013 Aug;42(2):213-7
pubmed: 23303574
Simul Healthc. 2021 Feb 1;16(1):52-59
pubmed: 32675735
Annu Int Conf IEEE Eng Med Biol Soc. 2022 Jul;2022:4461-4464
pubmed: 36086196

Auteurs

Manuel Birlo (M)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.

Philip J Eddie Edwards (PJE)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.

Soojeong Yoo (S)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.
UCL Interaction Centre (UCLIC), University College London, 66-72 Gower Street, London WC1E 6EA, UK.

Brian Dromey (B)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.
UCL EGA Institute for Women's Health, Medical School Building, 74 Huntley Street, London WC1E 6AU, UK.

Francisco Vasconcelos (F)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.

Matthew J Clarkson (MJ)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.

Danail Stoyanov (D)

Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43-45 Foley Street, London W1W 7TY, UK.

Classifications MeSH