Challenges of intracellular visualization using virtual and augmented reality.

Microscopy image observation is commonly performed on 2D screens, which limits human capacities to grasp volumetric, complex, and discrete biological dynamics. With the massive production of multidimensional images (3D + time, multi-channels) and derived images (e.g., restored images, segmentation maps, and object tracks), scientists need appropriate visualization and navigation methods to better apprehend the amount of information in their content. New modes of visualization have emerged, including virtual reality (VR)/augmented reality (AR) approaches which should allow more accurate analysis and exploration of large time series of volumetric images, such as those produced by the latest 3D + time fluorescence microscopy. They include integrated algorithms that allow researchers to interactively explore complex spatiotemporal objects at the scale of single cells or multicellular systems, almost in a real time manner. In practice, however, immersion of the user within 3D + time microscopy data represents both a paradigm shift in human-image interaction and an acculturation challenge, for the concerned community. To promote a broader adoption of these approaches by biologists, further dialogue is needed between the bioimaging community and the VR&AR developers.

Informations de copyright

Copyright © 2022 Valades-Cruz, Leconte, Fouche, Blanc, Van Hille, Fournier, Laurent, Gallean, Deslandes, Hajj, Faure, Argelaguet, Trubuil, Isenberg, Masson, Salamero and Kervrann.

Déclaration de conflit d'intérêts

J-BM is one of the cofounders, shareholder and Chief Scientific Officer (CSO) of AVATAR MEDICAL SAS, a startup that commercializes software for surgery planning in virtual reality. The DIVA software used in this perspective is not being commercialized by AVATAR MEDICAL SAS although the company’s technology is based on the same technology. The DIVA software used here is freely available and is reported in El Beheiry, et al. “DIVA: Natural Navigation Inside 3D Images Using Virtual Reality”. Journal of Molecular Biology 432, no. 16 (2020): 474. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.