Three-dimensional imaging through scattering media based on confocal diffuse tomography.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
09 09 2020
09 09 2020
Historique:
received:
15
04
2020
accepted:
07
08
2020
entrez:
10
9
2020
pubmed:
11
9
2020
medline:
11
9
2020
Statut:
epublish
Résumé
Optical imaging techniques, such as light detection and ranging (LiDAR), are essential tools in remote sensing, robotic vision, and autonomous driving. However, the presence of scattering places fundamental limits on our ability to image through fog, rain, dust, or the atmosphere. Conventional approaches for imaging through scattering media operate at microscopic scales or require a priori knowledge of the target location for 3D imaging. We introduce a technique that co-designs single-photon avalanche diodes, ultra-fast pulsed lasers, and a new inverse method to capture 3D shape through scattering media. We demonstrate acquisition of shape and position for objects hidden behind a thick diffuser (≈6 transport mean free paths) at macroscopic scales. Our technique, confocal diffuse tomography, may be of considerable value to the aforementioned applications.
Identifiants
pubmed: 32908155
doi: 10.1038/s41467-020-18346-3
pii: 10.1038/s41467-020-18346-3
pmc: PMC7481188
doi:
Types de publication
Journal Article
Research Support, U.S. Gov't, Non-P.H.S.
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
4517Références
Ntziachristos, V. Going deeper than microscopy: the optical imaging frontier in biology. Nat. Methods 7, 603–614 (2010).
pubmed: 20676081
Eggebrecht, A. T. et al. Mapping distributed brain function and networks with diffuse optical tomography. Nat. Photon. 8, 448–454 (2014).
Wang, L., Ho, P., Liu, C., Zhang, G. & Alfano, R. Ballistic 2-D imaging through scattering walls using an ultrafast optical Kerr gate. Science 253, 769–771 (1991).
pubmed: 17835493
Redo-Sanchez, A. et al. Terahertz time-gated spectral imaging for content extraction through layered structures. Nat. Commun. 7, 1–7 (2016).
Indebetouw, G. & Klysubun, P. Imaging through scattering media with depth resolution by use of low-coherence gating in spatiotemporal digital holography. Opt. Lett. 25, 212–214 (2000).
pubmed: 18059832
Dunsby, C. & French, P. Techniques for depth-resolved imaging through turbid media including coherence-gated imaging. J. Phys. D. 36, R207 (2003).
Kang, S. et al. Imaging deep within a scattering medium using collective accumulation of single-scattered waves. Nat. Photon. 9, 253–258 (2015).
Huang, D. et al. Optical coherence tomography. Science 254, 1178–1181 (1991).
pubmed: 1957169
pmcid: 4638169
Bertolotti, J. et al. Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012).
pubmed: 23135468
Katz, O., Heidmann, P., Fink, M. & Gigan, S. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photon. 8, 784–790 (2014).
Popoff, S., Lerosey, G., Fink, M., Boccara, A. C. & Gigan, S. Image transmission through an opaque material. Nat. Commun. 1, 1–5 (2010).
Vellekoop, I. M. & Mosk, A. Focusing coherent light through opaque strongly scattering media. Opt. Lett. 32, 2309–2311 (2007).
pubmed: 17700768
Horstmeyer, R., Ruan, H. & Yang, C. Guidestar-assisted wavefront-shaping methods for focusing light into biological tissue. Nat. Photon. 9, 563–571 (2015).
Vellekoop, I. M., Cui, M. & Yang, C. Digital optical phase conjugation of fluorescence in turbid tissue. Appl. Phys. Lett. 101, 81108 (2012).
pubmed: 22991478
Wang, K. et al. Rapid adaptive optical recovery of optimal resolution over large volumes. Nat. Methods 11, 625–628 (2014).
pubmed: 24727653
pmcid: 4069208
Katz, O., Small, E., Guan, Y. & Silberberg, Y. Noninvasive nonlinear focusing and imaging through strongly scattering turbid layers. Optica 1, 170–174 (2014).
Xu, X., Liu, H. & Wang, L. V. Time-reversed ultrasonically encoded optical focusing into scattering media. Nat. Photon. 5, 154–157 (2011).
Judkewitz, B., Wang, Y. M., Horstmeyer, R., Mathy, A. & Yang, C. Speckle-scale focusing in the diffusive regime with time reversal of variance-encoded light (TROVE). Nat. Photon. 7, 300–305 (2013).
Lai, P., Wang, L., Tay, J. W. & Wang, L. V. Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media. Nat. Photon. 9, 126–132 (2015).
Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun. 3, 1–8 (2012).
Liu, X. et al. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 572, 620–623 (2019).
pubmed: 31384042
O’Toole, M., Lindell, D. B. & Wetzstein, G. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 338–341 (2018).
pubmed: 29513650
Lindell, D. B., Wetzstein, G. & O’Toole, M. Wave-based non-line-of-sight imaging using fast f–k migration. ACM Trans. Graph. 38, 1–13 (2019).
Faccio, D., Velten, A. & Wetzstein, G. Non-line-of-sight imaging. Nat. Rev. Phys. 2, 318–327 (2020).
Liu, X., Bauer, S. & Velten, A. Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems. Nat. Commun. 11, 1–13 (2020).
Young, S., Lindell, D. B. & Wetzstein, G. Non-line-of-sight surface reconstruction using the directional light-cone transform. in Proc. CVPR pp. 1407–1416 (2020).
Boas, D. A. et al. Imaging the body with diffuse optical tomography. IEEE Signal Process. Mag. 18, 57–75 (2001).
Gibson, A. & Dehghani, H. Diffuse optical imaging. Philos. Trans. R. Soc. A 367, 3055–3072 (2009).
Arridge, S. R. & Schweiger, M. A gradient-based optimisation scheme for optical tomography. Opt. Express 2, 213–226 (1998).
pubmed: 19377605
Konecky, S. D. et al. Imaging complex structures with diffuse light. Opt. Express 16, 5048–5060 (2008).
pubmed: 18542605
pmcid: 2471872
Hebden, J. C., Hall, D. J. & Delpy, D. T. The spatial resolution performance of a time-resolved optical imaging system using temporal extrapolation. Med. Phys. 22, 201–208 (1995).
pubmed: 7565351
Cai, W. et al. Time-resolved optical diffusion tomographic image reconstruction in highly scattering turbid media. Proc. Natl Acad. Sci. USA 93, 13561 (1996).
pubmed: 11038527
Satat, G., Tancik, M. & Raskar, R. Towards photography through realistic fog. in Proc. ICCP pp. 1–10 (2018).
Gariepy, G. et al. Single-photon sensitive light-in-fight imaging. Nat. Commun. 6, 1–7 (2015).
Lyons, A. et al. Computational time-of-flight diffuse optical tomography. Nat. Photon. 13, 575–579 (2019).
Durduran, T., Choe, R., Baker, W. B. & Yodh, A. G. Diffuse optics for tissue monitoring and tomography. Rep. Prog. Phys. 73, 076701 (2010).
pubmed: 26120204
pmcid: 4482362
Badon, A. et al. Smart optical coherence tomography for ultra-deep imaging through highly scattering media. Sci. Adv. 2, e1600370 (2016).
pubmed: 27847864
pmcid: 5099988
Wang, Z. et al. Cubic meter volume optical coherence tomography. Optica 3, 1496–1503 (2016).
pubmed: 28239628
pmcid: 5325157
Satat, G., Heshmat, B., Raviv, D. & Raskar, R. All photons imaging through volumetric scattering. Sci. Rep. 6, 1–8 (2016).
Hoshi, Y. & Yamada, Y. Overview of diffuse optical tomography and its clinical applications. J. Biomed. Opt. 21, 091312 (2016).
pubmed: 27420810
Patterson, M. S., Chance, B. & Wilson, B. C. Time resolved reflectance and transmittance for the noninvasive measurement of tissue optical properties. Appl. Opt. 28, 2331–2336 (1989).
pubmed: 20555520
Farrell, T. J., Patterson, M. S. & Wilson, B. A diffusion theory model of spatially resolved, steady-state diffuse reflectance for the noninvasive determination of tissue optical properties in vivo. Med. Phys. 19, 879–888 (1992).
pubmed: 1518476
Haskell, R. C. et al. Boundary conditions for the diffusion equation in radiative transfer. JOSA A 11, 2727–2741 (1994).
pubmed: 7931757
Contini, D., Martelli, F. & Zaccanti, G. Photon migration through a turbid slab described by a model based on diffusion approximation. I. Theory. Appl. Opt. 36, 4587–4599 (1997).
pubmed: 18259254
Xin, S. et al. A theory of Fermat paths for non-line-of-sight shape reconstruction. in Proc. CVPR pp. 6800–6809 (2019).
Freund, I. Looking through walls and around corners. Phys. A 168, 49–65 (1990).
Landauer, R. & Buttiker, M. Diffusive traversal time: effective area in magnetically induced interference. Phys. Rev. B 36, 6255–6260 (1987).
Gkioulekas, I., Levin, A. & Zickler, T. An evaluation of computational imaging techniques for heterogeneous inverse scattering. in Proc. ECCV pp. 685–701 (2016).
Natarajan, C. M., Tanner, M. G. & Hadfield, R. H. Superconducting nanowire single-photon detectors: physics and applications. Supercond. Sci. Technol. 25, 063001 (2012).
Buzhan, P. et al. Silicon photomultiplier and its possible applications. Nucl. Instrum. Methods Phys. Res. A 504, 48–52 (2003).
Pettersen, E. F. et al. UCSF chimera-a visualization system for exploratory research and analysis. J. Comput. Chem. 25, 1605–1612 (2004).
pubmed: 15264254
pmcid: 15264254