Spectrally encoded single-pixel machine vision using diffractive networks.
Journal
Science advances
ISSN: 2375-2548
Titre abrégé: Sci Adv
Pays: United States
ID NLM: 101653440
Informations de publication
Date de publication:
Mar 2021
Mar 2021
Historique:
received:
10
07
2020
accepted:
10
02
2021
entrez:
27
3
2021
pubmed:
28
3
2021
medline:
28
3
2021
Statut:
epublish
Résumé
We demonstrate optical networks composed of diffractive layers trained using deep learning to encode the spatial information of objects into the power spectrum of the diffracted light, which are used to classify objects with a single-pixel spectroscopic detector. Using a plasmonic nanoantenna-based detector, we experimentally validated this single-pixel machine vision framework at terahertz spectrum to optically classify the images of handwritten digits by detecting the spectral power of the diffracted light at ten distinct wavelengths, each representing one class/digit. We also coupled this diffractive network-based spectral encoding with a shallow electronic neural network, which was trained to rapidly reconstruct the images of handwritten digits based on solely the spectral power detected at these ten distinct wavelengths, demonstrating task-specific image decompression. This single-pixel machine vision framework can also be extended to other spectral-domain measurement systems to enable new 3D imaging and sensing modalities integrated with diffractive network-based spectral encoding of information.
Identifiants
pubmed: 33771863
pii: 7/13/eabd7690
doi: 10.1126/sciadv.abd7690
pmc: PMC7997518
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Wellcome Trust
Pays : United Kingdom
Informations de copyright
Copyright © 2021 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).
Références
Light Sci Appl. 2019 Dec 2;8:112
pubmed: 31814969
Nat Mater. 2003 Apr;2(4):229-32
pubmed: 12690394
Science. 2018 Sep 7;361(6406):1004-1008
pubmed: 30049787
Light Sci Appl. 2021 Jan 28;10(1):25
pubmed: 33510131
Nature. 2020 Mar;579(7797):62-66
pubmed: 32132692
Science. 2007 Mar 23;315(5819):1686
pubmed: 17379801
Nature. 2003 Jun 5;423(6940):604-5
pubmed: 12789328
Light Sci Appl. 2020 Apr 13;9:59
pubmed: 32337023
Sci Adv. 2019 Dec 20;5(12):eaay6946
pubmed: 31903420
Nature. 2009 Oct 1;461(7264):629-32
pubmed: 19718019
Science. 2014 Jul 18;345(6194):298-302
pubmed: 25035488
Science. 2006 Nov 10;314(5801):977-80
pubmed: 17053110
Opt Express. 2006 Sep 4;14(18):8247-56
pubmed: 19529199
Adv Sci (Weinh). 2019 Dec 06;7(3):1901913
pubmed: 32042558
Science. 2006 Jun 23;312(5781):1780-2
pubmed: 16728597
Nat Commun. 2021 Jan 4;12(1):37
pubmed: 33397912
Nature. 2019 May;569(7755):208-214
pubmed: 31068721
Sci Rep. 2018 Aug 17;8(1):12324
pubmed: 30120316
Nat Mater. 2009 Jul;8(7):568-71
pubmed: 19404237
Science. 2016 Nov 18;354(6314):
pubmed: 27856851
Nat Commun. 2012 May 29;3:870
pubmed: 22643897
Science. 2019 Mar 22;363(6433):1333-1338
pubmed: 30898930
Appl Opt. 1985 May 15;24(10):1469
pubmed: 18223740
Appl Opt. 1987 Dec 1;26(23):5061-76
pubmed: 20523485
Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554-8
pubmed: 6953413
Sci Rep. 2017 Feb 16;7:42667
pubmed: 28205615
Science. 2007 Sep 21;317(5845):1698-702
pubmed: 17885123
Nature. 1990 Jan 25;343(6256):325-30
pubmed: 2300184
IEEE J Sel Top Quantum Electron. 2020 Jan-Feb;26(1):
pubmed: 33223801
Phys Rev Lett. 2000 Oct 30;85(18):3966-9
pubmed: 11041972
Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Jul;72(1 Pt 2):016623
pubmed: 16090123
Nat Mater. 2014 Feb;13(2):139-50
pubmed: 24452357
Science. 2005 Apr 22;308(5721):534-7
pubmed: 15845849