Collective and synchronous dynamics of photonic spiking neurons.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
23 04 2021
23 04 2021
Historique:
received:
07
08
2020
accepted:
16
03
2021
entrez:
24
4
2021
pubmed:
25
4
2021
medline:
11
5
2021
Statut:
epublish
Résumé
Nonlinear dynamics of spiking neural networks have recently attracted much interest as an approach to understand possible information processing in the brain and apply it to artificial intelligence. Since information can be processed by collective spiking dynamics of neurons, the fine control of spiking dynamics is desirable for neuromorphic devices. Here we show that photonic spiking neurons implemented with paired nonlinear optical oscillators can be controlled to generate two modes of bio-realistic spiking dynamics by changing optical-pump amplitude. When the photonic neurons are coupled in a network, the interaction between them induces an effective change in the pump amplitude depending on the order parameter that characterizes synchronization. The experimental results show that the effective change causes spontaneous modification of the spiking modes and firing rates of clustered neurons, and such collective dynamics can be utilized to realize efficient heuristics for solving NP-hard combinatorial optimization problems.
Identifiants
pubmed: 33893296
doi: 10.1038/s41467-021-22576-4
pii: 10.1038/s41467-021-22576-4
pmc: PMC8065174
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
2325Références
Silver, D. et al. Mastering the game of Go without human knowledge. Nature 550, 354–359 (2017).
pubmed: 29052630
doi: 10.1038/nature24270
Devlin, J., Chang, M., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. arXiv 1810, 04805 (2019).
Bojarski, M. et al. End to end learning for self-driving cars. arXiv 1604, 07316 (2016).
Hamerly, R., Bernstein, L., Sludds, A., Soljačić, M. & Englund, D. Large-scale optical neural networks based on photoelectric multiplication. Phys. Rev. X 9, 021032 (2019).
Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T. & Maida, A. Deep learning in spiking neural networks. Neural Networks 111, 47–63 (2019).
pubmed: 30682710
doi: 10.1016/j.neunet.2018.12.002
Bellec, G. et al. Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets. arXiv 1901, 09049 (2019).
Indiveri, G. et al. Neuromorphic silicon neuron circuits. Front. Neurosci. 5, 73 (2011).
pubmed: 21747754
pmcid: 3130465
doi: 10.3389/fnins.2011.00073
Merolla, P. A. et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345, 668–673 (2014).
pubmed: 25104385
doi: 10.1126/science.1254642
Furber, S. B., Galluppi, F., Temple, S. & Plana, L. A. The SpiNNaker project. Proc. IEEE 102, 5 (2014).
doi: 10.1109/JPROC.2014.2304638
Pfeil, T. et al. Effect of heterogeneity on decorrelation mechanisms in spiking neural networks: a neuromorphic-hardware study. Phys. Rev. X 6, 021023 (2016).
Brette, R. Philosophy of the spike: rate-based vs. spike-based theories of the brain. Front. Syst. Neurosci. 9, 151 (2015).
pubmed: 26617496
pmcid: 4639701
doi: 10.3389/fnsys.2015.00151
Riehle, A., Grün, S., Diesmann, M. & Aertsen, A. Spike synchronization and rate modulation differentially involved in motor cortical function. Science 278, 1950–1953 (1997).
pubmed: 9395398
doi: 10.1126/science.278.5345.1950
Toubou, J. D., Piette, C., Venance, L. & Ermentrout, G. B. Noise-induced synchronization and antiresonance in interacting excitable systems: applications to deep brain stimulation in Parkinson’s disease. Phys. Rev. X 10, 011073 (2020).
Das, A. & Levina, A. Critical neuronal models with relaxed timescale separation. Phys. Rev. X 9, 021062 (2019).
Rosenbluth, D., Kravtsov, K., Fok, M. P. & Prucnal, P. R. A high performance photonic pulse processing device. Optics Express 17, 22767–22772 (2009).
pubmed: 20052202
doi: 10.1364/OE.17.022767
Shastri, B. J., Nahmias, M. A., Tait, A. N., Wu, B. & Prucnal, P. R. SIMPEL: Circuit model for photonic spike processing laser neurons. Optics Express 23, 8029–8044 (2015).
pubmed: 25837141
doi: 10.1364/OE.23.008029
Coomans, W., Gelens, L., Beri, S., Danckaert, J., & Van der Sande, G. Solitary and coupled semiconductor ring lasers as optical spiking neurons. Phys. Rev. E 84, 036209 (2011).
doi: 10.1103/PhysRevE.84.036209
Goulding, D. et al. Excitability in a quantum dot semiconductor laser with optical injection. Phys. Rev. Lett. 98, 153903 (2007).
pubmed: 17501351
doi: 10.1103/PhysRevLett.98.153903
Yacomotti, A. M. et al. Fast thermo-optical excitability in a two-dimensional photonic crystal. Phys. Rev. Lett. 97, 143904 (2006).
pubmed: 17155254
doi: 10.1103/PhysRevLett.97.143904
Tait, A. N. et al. Neuromorphic photonic networks using silicon photonic weight banks. Sci. Rep. 7, 7430 (2017).
pubmed: 28784997
pmcid: 5547135
doi: 10.1038/s41598-017-07754-z
Feldmann, J., Youngblood, N., Wright, C. D., Bhaskaran, H. & Pernice, W. H. P. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature 569, 208–214 (2019).
pubmed: 31068721
pmcid: 6522354
doi: 10.1038/s41586-019-1157-8
Totović, A. R., Dabos, G., Passalis, N., Tefas, A. & Pleros, N. Femtojoule per MAC neuromorphic photonics: an energy and technology roadmap. IEEE J. Select Top Quantum Electronics 26, 1–15 (2020).
doi: 10.1109/JSTQE.2020.2975579
Bello, L., Strinati, M. C., Torre, E. G. D. & Pe’er, A. Persistent coherent beating in coupled parametric oscillators. Phys. Rev. Lett. 123, 083901 (2019).
pubmed: 31491203
doi: 10.1103/PhysRevLett.123.083901
Strinati, M. C., Bello, L., Pe’er, A. & Torre, E. G. D. Theory of coupled parametric oscillators beyond coupled Ising spins. Phys. Rev. A. 100, 023835 (2019).
doi: 10.1103/PhysRevA.100.023835
Dolcemascolo, A., Miazek, A., Veltz, R., Marino, F. & Barland, S. Effective low-dimensional dynamics of a mean-field coupled network of slow-fast spiking lasers. Phys. Rev. E 101, 052208 (2020).
pubmed: 32575292
doi: 10.1103/PhysRevE.101.052208
Hodgkin, A. L. The local electric changes associated with repetitive action in a nonmedullated axon. J. Physiol. 107, 165–181 (1948).
pubmed: 16991796
pmcid: 1392160
doi: 10.1113/jphysiol.1948.sp004260
Rinzel, J. & Ermentrout, B. Analysis of neural excitability and oscillations. Methods in Neuronal Modeling 2, 251–292 (1998). MIT Press, Cambridge, MA.
Izhikevich, E. M. Dynamical Systems in Neuroscience. MIT Press, Cambridge, MA (2007).
Dayan, P. & Abbott, L. F. Theoretical Neuroscience. MIT Press, Cambridge, MA (2001).
Izhikevich, E. M. Which model to use for cortical spiking neurons?. IEEE Trans Neural Networks 15, 1063–1070 (2004).
pubmed: 15484883
doi: 10.1109/TNN.2004.832719
Tsuji, S., Ueta, T., Kawakami, H., Fujii, H. & Aihara, K. Bifurcations in two-dimensional hindmarsh-rose type model. Int. J. Bifurcation Chaos 17, 985–998 (2007).
doi: 10.1142/S0218127407017707
Li, J., Katori, Y. & Kohno, T. An FPGA-based silicon neuronal network with selectable excitability silicon neurons. Front. Neurosci. 6, 183 (2012).
pubmed: 23269911
pmcid: 3529302
doi: 10.3389/fnins.2012.00183
Marandi, A., Wang, Z., Takata, K., Byer, R. L. & Yamamoto, Y. Network of time-multiplexed optical parametric oscillators as a coherent Ising machine. Nat. Photonics 8, 937–942 (2014).
doi: 10.1038/nphoton.2014.249
Inagaki, T. et al. Large-scale Ising spin network based on degenerate optical parametric oscillators. Nat. Photonics 10, 415–419 (2016).
doi: 10.1038/nphoton.2016.68
Inagaki, T. et al. A coherent Ising machine for 2000-node optimization problems. Science 354, 603–606 (2016).
pubmed: 27811271
doi: 10.1126/science.aah4243
McMahon, P. L. et al. A fully programmable 100-spin coherent Ising machine with all-to-all connections. Science 354, 614–617 (2016).
pubmed: 27811274
doi: 10.1126/science.aah5178
Böhm, F. et al. Understanding dynamics of coherent Ising machines through simulation of large-scale 2D Ising models. Nat. Commun. 9, 5020 (2018).
pubmed: 30479329
pmcid: 6258683
doi: 10.1038/s41467-018-07328-1
Nabors, C. D., Yang, S. T., Day, T. & Byer, R. L. Coherence properties of a doubly-resonant monolithic optical parametric oscillator. J. Opt. Soc. Am. B 7, 815–820 (1990).
doi: 10.1364/JOSAB.7.000815
Marandi, A., Leindecker, N. C., Pervak, V., Byer, R. L. & Vodopyanov, K. L. Coherence properties of a broadband femtosecond mid-IR optical parametric oscillator operating at degeneracy. Opt. Express 20, 7255–7262 (2012).
pubmed: 22453407
doi: 10.1364/OE.20.007255
Serkland, D. K., Bartolini, G. D., Agarwal, A., Kumar, P. & Kath, W. L. Pulsed degenerate optical parametric oscillator based on a nonlinear-fiber Sagnac interferometer. Opt. Lett. 23, 795–797 (1998).
pubmed: 18087345
doi: 10.1364/OL.23.000795
Wang, Z., Marandi, A., Wen, K., Byer, R. L. & Yamamoto, Y. Coherent Ising machine based on degenerate optical parametric oscillators. Phys. Rev. A 88, 063853 (2013).
doi: 10.1103/PhysRevA.88.063853
Maruo, D., Utsunomiya, S. & Yamamoto, Y. Truncated Wigner theory of coherent Ising machines based on degenerate optical parametric oscillator network. Phys. Scripta 91, 8 (2016).
doi: 10.1088/0031-8949/91/8/083010
Drummond, P. D., McNeil, K. J. & Walls, D. F. Non-equilibrium transitions in sub/second harmonic generation. Optica Acta: Int. J. Optics 27, 3321–3335 (1980).
doi: 10.1080/713820226
Umeki, T., Tadanaga, O., Takada, A. & Asobe, M. Phase sensitive degenerate parametric amplification using directly-bonded PPLN ridge waveguides. Opt. Express 19, 6326–6332 (2011).
pubmed: 21451659
doi: 10.1364/OE.19.006326
Haribara, Y., Yamamoto, Y., Kawarabayashi, K. I. & Utsunomiya, S. A coherent Ising machine for MAX-CUT problems: performance evaluation against semidefinite programming relaxation and simulated annealing. Encyclopedia of Spectroscopy and Spectrometry, 3rd Edition (Elsevier, 2016); http://arxiv.org/abs/1501.07030 (2015).
Kuramoto, Y. Self-entrainment of a population of coupled non-linear oscillators. International Symposium on Mathematical Problems in Theoretical Physics. Lecture Notes in Physics, 39. Springer, Berlin, Heidelberg (1975).
Acebrón, J. A., Bonilla, L. L., Vicente, C. J. P., Ritort, F. & Spigler, R. The Kuramoto model: a simple paradigm for synchronization phenomena. Rev. Mod. Phys. 77, 137 (2005).
doi: 10.1103/RevModPhys.77.137
Ising, E. Beitrag zur theorie des ferromagnetismus. Zeitschrift fur Physik A 31, 253–258 (1925).
doi: 10.1007/BF02980577
Liers, F. & Jünger, M. Spin glass server, http://informatik.uni-koeln.de/spinglass/ .
Hamerly, R. et al. Experimental investigation of performance differences between coherent Ising machines and a quantum annealer. Sci. Adv. 5, eaau0823 (2019).
pubmed: 31139743
pmcid: 6534389
doi: 10.1126/sciadv.aau0823
Kalinin, K. P. & Berloff, N. G. Complexity continuum within Ising formulation of NP problems. arXiv: 2008.00466 (2020).
Boettcher, S. & Percus, A. G. Optimization with extremal dynamics. Phys. Rev. Lett. 86, 5211 (2001).
pubmed: 11384460
doi: 10.1103/PhysRevLett.86.5211
Hoffmann, H. & Payton, D. W. Optimization by self-organized criticality. Sci. Rep. 8, 2358 (2018).
pubmed: 29402956
pmcid: 5799203
doi: 10.1038/s41598-018-20275-7
Shen, Y. et al. Deep learning with coherent nanophotonic circuits. Nat. Photon. 11, 441–446 (2017).
doi: 10.1038/nphoton.2017.93
Okawachi, Y. et al. Demonstration of chip-based coupled degenerate optical parametric oscillators for realizing a nanophotonic spin-glass. Nat. Commun. 11, 4119 (2020).
pubmed: 32807796
pmcid: 7431591
doi: 10.1038/s41467-020-17919-6
Pierangeli, D., Marcucci, G. & Conti, C. Large-scale photonic ising machine by spatial light modulation. Phys. Rev. Lett. 122, 213902 (2019).
pubmed: 31283311
doi: 10.1103/PhysRevLett.122.213902
Pierangeli, D., Marcucci, G. & Conti, C. Adiabatic evolution on a spatial-photonic Ising machine. Optica 7, 1535 (2020).
doi: 10.1364/OPTICA.398000
Prabhu, M. et al. Accelerating recurrent Ising machines in photonic integrated circuits. Optica 7, 551 (2020).
doi: 10.1364/OPTICA.386613
Roques-Carmes, C. et al. Heuristic recurrent algorithms for photonic Ising machines. Nat. Commun. 11, 249 (2020).
pubmed: 31937776
pmcid: 6959305
doi: 10.1038/s41467-019-14096-z