Spectrally encoded single-pixel machine vision using diffractive networks.


Journal

Science advances
ISSN: 2375-2548
Titre abrégé: Sci Adv
Pays: United States
ID NLM: 101653440

Informations de publication

Date de publication:
Mar 2021
Historique:
received: 10 07 2020
accepted: 10 02 2021
entrez: 27 3 2021
pubmed: 28 3 2021
medline: 28 3 2021
Statut: epublish

Résumé

We demonstrate optical networks composed of diffractive layers trained using deep learning to encode the spatial information of objects into the power spectrum of the diffracted light, which are used to classify objects with a single-pixel spectroscopic detector. Using a plasmonic nanoantenna-based detector, we experimentally validated this single-pixel machine vision framework at terahertz spectrum to optically classify the images of handwritten digits by detecting the spectral power of the diffracted light at ten distinct wavelengths, each representing one class/digit. We also coupled this diffractive network-based spectral encoding with a shallow electronic neural network, which was trained to rapidly reconstruct the images of handwritten digits based on solely the spectral power detected at these ten distinct wavelengths, demonstrating task-specific image decompression. This single-pixel machine vision framework can also be extended to other spectral-domain measurement systems to enable new 3D imaging and sensing modalities integrated with diffractive network-based spectral encoding of information.

Identifiants

pubmed: 33771863
pii: 7/13/eabd7690
doi: 10.1126/sciadv.abd7690
pmc: PMC7997518
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : Wellcome Trust
Pays : United Kingdom

Informations de copyright

Copyright © 2021 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).

Références

Light Sci Appl. 2019 Dec 2;8:112
pubmed: 31814969
Nat Mater. 2003 Apr;2(4):229-32
pubmed: 12690394
Science. 2018 Sep 7;361(6406):1004-1008
pubmed: 30049787
Light Sci Appl. 2021 Jan 28;10(1):25
pubmed: 33510131
Nature. 2020 Mar;579(7797):62-66
pubmed: 32132692
Science. 2007 Mar 23;315(5819):1686
pubmed: 17379801
Nature. 2003 Jun 5;423(6940):604-5
pubmed: 12789328
Light Sci Appl. 2020 Apr 13;9:59
pubmed: 32337023
Sci Adv. 2019 Dec 20;5(12):eaay6946
pubmed: 31903420
Nature. 2009 Oct 1;461(7264):629-32
pubmed: 19718019
Science. 2014 Jul 18;345(6194):298-302
pubmed: 25035488
Science. 2006 Nov 10;314(5801):977-80
pubmed: 17053110
Opt Express. 2006 Sep 4;14(18):8247-56
pubmed: 19529199
Adv Sci (Weinh). 2019 Dec 06;7(3):1901913
pubmed: 32042558
Science. 2006 Jun 23;312(5781):1780-2
pubmed: 16728597
Nat Commun. 2021 Jan 4;12(1):37
pubmed: 33397912
Nature. 2019 May;569(7755):208-214
pubmed: 31068721
Sci Rep. 2018 Aug 17;8(1):12324
pubmed: 30120316
Nat Mater. 2009 Jul;8(7):568-71
pubmed: 19404237
Science. 2016 Nov 18;354(6314):
pubmed: 27856851
Nat Commun. 2012 May 29;3:870
pubmed: 22643897
Science. 2019 Mar 22;363(6433):1333-1338
pubmed: 30898930
Appl Opt. 1985 May 15;24(10):1469
pubmed: 18223740
Appl Opt. 1987 Dec 1;26(23):5061-76
pubmed: 20523485
Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554-8
pubmed: 6953413
Sci Rep. 2017 Feb 16;7:42667
pubmed: 28205615
Science. 2007 Sep 21;317(5845):1698-702
pubmed: 17885123
Nature. 1990 Jan 25;343(6256):325-30
pubmed: 2300184
IEEE J Sel Top Quantum Electron. 2020 Jan-Feb;26(1):
pubmed: 33223801
Phys Rev Lett. 2000 Oct 30;85(18):3966-9
pubmed: 11041972
Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Jul;72(1 Pt 2):016623
pubmed: 16090123
Nat Mater. 2014 Feb;13(2):139-50
pubmed: 24452357
Science. 2005 Apr 22;308(5721):534-7
pubmed: 15845849

Auteurs

Jingxi Li (J)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Deniz Mengu (D)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Nezih T Yardimci (NT)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Yi Luo (Y)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Xurong Li (X)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Muhammed Veli (M)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Yair Rivenson (Y)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Mona Jarrahi (M)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Aydogan Ozcan (A)

Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA. ozcan@ucla.edu.
Bioengineering Department, University of California, Los Angeles, CA 90095, USA.
California NanoSystems Institute (CNSI), University of California, Los Angeles, CA 90095, USA.

Classifications MeSH