Medical Augmented Reality: Definition, Principle Components, Domain Modeling, and Design-Development-Validation Process.

Artificial Intelligence Augmented Reality Medical Augmented Reality acoustic sensing computer vision multi-modal sensing perceptual visualization sonification surgical data science validation

Journal

Journal of imaging
ISSN: 2313-433X
Titre abrégé: J Imaging
Pays: Switzerland
ID NLM: 101698819

Informations de publication

Date de publication:
23 Dec 2022
Historique:
received: 10 11 2022
revised: 15 12 2022
accepted: 19 12 2022
entrez: 20 1 2023
pubmed: 21 1 2023
medline: 21 1 2023
Statut: epublish

Résumé

Three decades after the first set of work on Medical Augmented Reality (MAR) was presented to the international community, and ten years after the deployment of the first MAR solutions into operating rooms, its exact definition, basic components, systematic design, and validation still lack a detailed discussion. This paper defines the basic components of any Augmented Reality (AR) solution and extends them to exemplary Medical Augmented Reality Systems (MARS). We use some of the original MARS applications developed at the Chair for Computer Aided Medical Procedures and deployed into medical schools for teaching anatomy and into operating rooms for telemedicine and surgical guidance throughout the last decades to identify the corresponding basic components. In this regard, the paper is not discussing all past or existing solutions but only aims at defining the principle components and discussing the particular domain modeling for MAR and its design-development-validation process, and providing exemplary cases through the past in-house developments of such solutions.

Identifiants

pubmed: 36662102
pii: jimaging9010004
doi: 10.3390/jimaging9010004
pmc: PMC9866223
pii:
doi:

Types de publication

Journal Article

Langues

eng

Références

IEEE Trans Med Imaging. 2010 Jul;29(7):1412-23
pubmed: 20659830
IEEE Trans Vis Comput Graph. 2022 Nov;28(11):3694-3704
pubmed: 36048998
Langenbecks Arch Surg. 2013 Apr;398(4):501-14
pubmed: 23430289
Int J Comput Assist Radiol Surg. 2016 Jun;11(6):967-75
pubmed: 27059022
IEEE Trans Vis Comput Graph. 2022 May;28(5):2190-2200
pubmed: 35148264
Digit Biomark. 2020 Nov 26;4(Suppl 1):59-72
pubmed: 33442581
IEEE Trans Med Imaging. 2021 Feb;40(2):765-778
pubmed: 33166252
Unfallchirurg. 2012 Mar;115(3):209-13
pubmed: 22406917
Med Image Anal. 2022 Apr;77:102361
pubmed: 35168103
IEEE Trans Vis Comput Graph. 2021 Nov;27(11):4129-4139
pubmed: 34449373
IEEE Comput Graph Appl. 2007 Sep-Oct;27(5):10-4
pubmed: 17913019
World J Surg. 2011 Sep;35(9):1961-9
pubmed: 21597890
Anat Sci Educ. 2019 Nov;12(6):585-598
pubmed: 30697948
IEEE Trans Med Imaging. 2009 Sep;28(9):1498-510
pubmed: 19336291
Med Image Comput Comput Assist Interv. 2007;10(Pt 2):909-17
pubmed: 18044655
IEEE Trans Vis Comput Graph. 2017 Nov;23(11):2366-2371
pubmed: 28809687
Int J Comput Assist Radiol Surg. 2020 May;15(5):771-779
pubmed: 32323212
Int J Med Robot. 2018 Apr;14(2):
pubmed: 29266806
Int J Comput Assist Radiol Surg. 2019 Jun;14(6):913-922
pubmed: 30863981
Anat Sci Educ. 2019 Nov;12(6):599-609
pubmed: 30648818
Comput Med Imaging Graph. 2015 Apr;41:55-60
pubmed: 24998759
Med Image Comput Comput Assist Interv. 2007;10(Pt 1):434-41
pubmed: 18051088
Int J Comput Assist Radiol Surg. 2019 Sep;14(9):1553-1563
pubmed: 31350704
IEEE Trans Vis Comput Graph. 2022 Dec;28(12):4156-4171
pubmed: 33979287
Int J Comput Assist Radiol Surg. 2016 Jun;11(6):1007-14
pubmed: 26995603

Auteurs

Nassir Navab (N)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.

Alejandro Martin-Gomez (A)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.
Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD 21218, USA.

Matthias Seibold (M)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.
Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland.

Michael Sommersperger (M)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.

Tianyu Song (T)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.

Alexander Winkler (A)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.
Department of General, Visceral, and Transplant Surgery, Ludwig-Maximilians-University Hospital, DE-80336 Munich, Germany.

Kevin Yu (K)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.
medPhoton GmbH, AT-5020 Salzburg, Austria.

Ulrich Eck (U)

Computer Aided Medical Procedures & Augmented Reality, Technical University Munich, DE-85748 Garching, Germany.

Classifications MeSH