Toward a generalized Bienenstock-Cooper-Munro rule for spatiotemporal learning via triplet-STDP in memristive devices.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
20 03 2020
20 03 2020
Historique:
received:
31
07
2019
accepted:
12
02
2020
entrez:
22
3
2020
pubmed:
22
3
2020
medline:
22
3
2020
Statut:
epublish
Résumé
The close replication of synaptic functions is an important objective for achieving a highly realistic memristor-based cognitive computation. The emulation of neurobiological learning rules may allow the development of neuromorphic systems that continuously learn without supervision. In this work, the Bienenstock-Cooper-Munro learning rule, as a typical case of spike-rate-dependent plasticity, is mimicked using a generalized triplet-spike-timing-dependent plasticity scheme in a WO
Identifiants
pubmed: 32198368
doi: 10.1038/s41467-020-15158-3
pii: 10.1038/s41467-020-15158-3
pmc: PMC7083931
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1510Références
Mead, C. Neuromorphic electronic systems. P. IEEE 78, 1629–1636 (1990).
doi: 10.1109/5.58356
Yu, S. et al. A low energy oxide‐based electronic synaptic device for neuromorphic visual systems with tolerance to device variation. Adv. Mater. 25, 1774–1779 (2013).
pubmed: 23355110
doi: 10.1002/adma.201203680
pmcid: 23355110
Zidan, M. A., Strachan, J. P. & Lu, W. D. The future of electronics based on memristive systems. Nat. Electron. 1, 22 (2018).
doi: 10.1038/s41928-017-0006-8
Lv, Z., Zhou, Y., Han, S.-T. & Roy, V. From biomaterial-based data storage to bio-inspired artificial synapse. Mater. Today 21, 537–552 (2018).
doi: 10.1016/j.mattod.2017.12.001
Zhou, F. et al. Low-voltage, optoelectronic CH
doi: 10.1002/adfm.201800080
Zhao, X. et al. Photocatalytic reduction of graphene oxide-TiO
doi: 10.1002/smll.201801325
Yao, P. et al. Face classification using electronic synapses. Nat. Commun. 8, 15199 (2017).
pubmed: 28497781
pmcid: 5437298
doi: 10.1038/ncomms15199
Merolla, P. A. et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345, 668–673 (2014).
pubmed: 25104385
doi: 10.1126/science.1254642
pmcid: 25104385
Wang, Y. et al. Photonic synapses based on inorganic perovskite quantum dots for neuromorphic computing. Adv. Mater. 30, 1802883 (2018).
doi: 10.1002/adma.201802883
Wang, J. & Zhuge, F. Memristive synapses for brain-inspired computing. Adv. Mater. Technol. 4, 1800544 (2019).
doi: 10.1002/admt.201800544
Lin, Y. et al. Analog-digital hybrid memristive devices for image pattern recognition with tunable learning accuracy and speed. Small Methods 3, 1900160 (2019).
doi: 10.1002/smtd.201900160
Wu, W. et al. A methodology to improve linearity of analog RRAM for neuromorphic computing. in IEEE symposium on VLSI technology 103–104 (IEEE, 2018).
Ren, Y. et al. Analytical modeling of organic-inorganic CH
doi: 10.1002/adts.201700035
Jo, S. H. et al. Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett. 10, 1297–1301 (2010).
pubmed: 20192230
doi: 10.1021/nl904092h
pmcid: 20192230
Wang, Z. et al. Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nat. Mater. 16, 101 (2017).
pubmed: 27669052
doi: 10.1038/nmat4756
pmcid: 27669052
Kim, S. et al. Experimental demonstration of a second-order memristor and its ability to biorealistically implement synaptic plasticity. Nano Lett. 15, 2203–2211 (2015).
pubmed: 25710872
doi: 10.1021/acs.nanolett.5b00697
pmcid: 25710872
Pershin, Y. V. & Di, V. M. Neuromorphic, digital, and quantum computation with memory circuit elements. P. IEEE 100, 2071–2080 (2012).
doi: 10.1109/JPROC.2011.2166369
Yu, S., Wu, Y., Jeyasingh, R., Kuzum, D. & Wong, H.-S. P. An electronic synapse device based on metal oxide resistive switching memory for neuromorphic computation. IEEE T. Electron Dev. 58, 2729–2737 (2011).
doi: 10.1109/TED.2011.2147791
Zhu, X. et al. Observation of conductance quantization in oxide‐based resistive switching memory. Adv. Mater. 24, 3941–3946 (2012).
pubmed: 22707001
doi: 10.1002/adma.201201506
pmcid: 22707001
Chang, T., Jo, S.-H. & Lu, W. Short-term memory to long-term memory transition in a nanoscale memristor. ACS Nano 5, 7669–7676 (2011).
pubmed: 21861506
doi: 10.1021/nn202983n
pmcid: 21861506
Wang, Z. Q. et al. Synaptic learning and memory functions achieved using oxygen ion migration/diffusion in an amorphous InGaZnO memristor. Adv. Funct. Mater. 22, 2759–2765 (2012).
doi: 10.1002/adfm.201103148
Lin, Y. et al. Transferable and flexible artificial memristive synapse based on WO
doi: 10.1002/aelm.201800373
Ascoli, A., Corinto, F. & Tetzlaff, R. Generalized boundary condition memristor model. Int. J. Circuit Theory Appl. 44, 60–84 (2016).
doi: 10.1002/cta.2063
Wang, Z., Ambrogio, S., Balatti, S. & Ielmini, D. A 2-transistor/1-resistor artificial synapse capable of communication and stochastic learning in neuromorphic systems. Front. Neurosci. 8, 438 (2015).
pubmed: 25642161
pmcid: 4295533
doi: 10.3389/fnins.2014.00438
Tan, Z. H. et al. Synaptic metaplasticity realized in oxide memristive devices. Adv. Mater. 28, 377–384 (2016).
pubmed: 26573772
doi: 10.1002/adma.201503575
pmcid: 26573772
Kim, M.-K. & Lee, J.-S. Short-term plasticity and long-term potentiation in artificial biosynapses with diffusive dynamics. ACS Nano 12, 1680–1687 (2018).
pubmed: 29357225
doi: 10.1021/acsnano.7b08331
pmcid: 29357225
Li, B. et al. Mediating short‐term plasticity in an Artificial memristive synapse by the orientation of silica mesopores. Adv. Mater. 30, 1706395 (2018).
doi: 10.1002/adma.201706395
De La Rocha, J., Doiron, B., Shea-Brown, E., Josić, K. & Reyes, A. Correlation between neural spike trains increases with firing rate. Nature 448, 802 (2007).
pubmed: 17700699
doi: 10.1038/nature06028
pmcid: 17700699
Sjöström, P. J., Turrigiano, G. G. & Nelson, S. B. Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 32, 1149–1164 (2001).
pubmed: 11754844
doi: 10.1016/S0896-6273(01)00542-6
pmcid: 11754844
Kirkwood, A., Rioult, M. G. & Bear, M. F. Experience-dependent modification of synaptic plasticity in visual cortex. Nature 381, 526 (1996).
pubmed: 8632826
doi: 10.1038/381526a0
pmcid: 8632826
Bear, M. F., Cooper, L. N. & Ebner, F. F. A physiological basis for a theory of synapse modification. Science 237, 42–48 (1987).
pubmed: 3037696
doi: 10.1126/science.3037696
pmcid: 3037696
Cooper, L. N. & Bear, M. F. The BCM theory of synapse modification at 30: interaction of theory with experiment. Nat. Rev. Neurosci. 13, 798 (2012).
pubmed: 23080416
doi: 10.1038/nrn3353
pmcid: 23080416
Zenke, F., Agnes, E. J. & Gerstner, W. Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks. Nat. Commun. 6, 6922 (2015).
pubmed: 25897632
pmcid: 4411307
doi: 10.1038/ncomms7922
Du, C., Ma, W., Chang, T., Sheridan, P. & Lu, W. D. Biorealistic implementation of synaptic functions with oxide memristors through internal ionic dynamics. Adv. Funct. Mater. 25, 4290–4299 (2015).
doi: 10.1002/adfm.201501427
Yin, J. et al. Adaptive crystallite kinetics in homogenous bilayer oxide memristor for emulating diverse synaptic plasticity. Adv. Funct. Mater. 28, 1706927 (2018).
doi: 10.1002/adfm.201706927
Xiong, J. et al. Bienenstock, Cooper, and Munro Learning Rules Realized in Second‐order memristors with tunable forgetting rate. Adv. Funct. Mater. 29, 1807316 (2019).
doi: 10.1002/adfm.201807316
Kurashige, H. & Sakai, Y. BCM-type synaptic plasticity model using a linear summation of calcium elevations as a sliding threshold. in International Conference on Neural Information Processing 19–29 (Springer, 2006).
Artola, A. & Singer, W. Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends Neurosci. 16, 480–487 (1993).
pubmed: 7507622
doi: 10.1016/0166-2236(93)90081-V
pmcid: 7507622
Gjorgjieva, J., Clopath, C., Audet, J. & Pfister, J.-P. A triplet spike-timing–dependent plasticity model generalizes the Bienenstock-Cooper-Munro rule to higher-order spatiotemporal correlations. Pro. Natl Acad. Sci. USA 108, 19383–19388 (2011).
doi: 10.1073/pnas.1105933108
Pfister, J.-P. & Gerstner, W. Triplets of spikes in a model of spike timing-dependent plasticity. J. Neurosci. 26, 9673–9682 (2006).
pubmed: 16988038
pmcid: 6674434
doi: 10.1523/JNEUROSCI.1425-06.2006
Froemke, R. C. & Dan, Y. Spike-timing-dependent synaptic modification induced by natural spike trains. Nature 416, 433 (2002).
pubmed: 11919633
doi: 10.1038/416433a
pmcid: 11919633
Wang, H.-X., Gerkin, R. C., Nauen, D. W. & Bi, G.-Q. Coactivation and timing-dependent integration of synaptic potentiation and depression. Nat. Neurosci. 8, 187 (2005).
pubmed: 15657596
doi: 10.1038/nn1387
pmcid: 15657596
Ahmed, T. et al. High order synaptic learning in neuro-mimicking resistive memories. arXiv preprint arXiv, 180406688 (2018).
Yang, R. et al. Synaptic suppression triplet-STDP learning rule realized in second-order memristors. Adv. Funct. Mater. 28, 1704455 (2018).
doi: 10.1002/adfm.201704455
Milo, V. et al. A 4-transistors/one-resistor hybrid synapse based on resistive switching memory (RRAM) capable of spike-rate dependent plasticity (SRDP). IEEE Trans. VLSI 26, 2806–2815 (2018).
doi: 10.1109/TVLSI.2018.2818978
Wang, W. et al. Surface diffusion-limited lifetime of silver and copper nanofilaments in resistive switching devices. Nat. Commun. 10, 81 (2019).
pubmed: 30622251
pmcid: 6325242
doi: 10.1038/s41467-018-07979-0
Abbott, L. F. & Nelson, S. B. Synaptic plasticity: taming the beast. Nat. Neurosci. 3, 1178 (2000).
pubmed: 11127835
doi: 10.1038/81453
pmcid: 11127835
Baeumer, C. et al. Verification of redox-processes as switching and retention failure mechanisms in Nb:SrTiO
pubmed: 27089047
doi: 10.1039/C6NR00824K
pmcid: 27089047
Yang, R. et al. Synaptic plasticity and memory functions achieved in a WO
pubmed: 23999098
doi: 10.1088/0957-4484/24/38/384003
pmcid: 23999098
Yang, C. S. et al. All-solid-state synaptic transistor with ultralow conductance for neuromorphic computing. Adv. Funct. Mater. 28, 1804170 (2018).
doi: 10.1002/adfm.201804170
Turrigiano, G. G. & Nelson, S. B. Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5, 97 (2004).
pubmed: 14735113
doi: 10.1038/nrn1327
pmcid: 14735113
Rachmuth, G., Shouval, H. Z., Bear, M. F. & Poon, C.-S. A biophysically-based neuromorphic model of spike rate-and timing-dependent plasticity. Pro. Natl Acad. Sci. USA 108, E1266–E1274 (2011).
doi: 10.1073/pnas.1106161108
Burkitt, A. N., Meffin, H. & Grayden, D. B. Spike-timing-dependent plasticity: the relationship to rate-based learning for models with weight dynamics determined by a stable fixed point. Neural Comput. 16, 885–940 (2004).
pubmed: 15070504
doi: 10.1162/089976604773135041
pmcid: 15070504
Sun, L. et al. Synaptic computation enabled by joule heating of single-layered semiconductors for sound localization. Nano Lett. 18, 3229–3234 (2018).
pubmed: 29668290
doi: 10.1021/acs.nanolett.8b00994
pmcid: 29668290
Wang, W. et al. Learning of spatiotemporal patterns in a spiking neural network with resistive switching synapses. Sci. Adv. 4, eaat4752 (2018).
pubmed: 30214936
pmcid: 6135543
doi: 10.1126/sciadv.aat4752
Azghadi, M. R., Al-Sarawi, S., Iannella, N. & Abbott, D. Design and implementation of BCM rule based on spike-timing dependent plasticity. in Neural Networks (IJCNN), International Joint Conference on 1-7 (IEEE, 2012).
Cai, W., Ellinger, F. & Tetzlaff, R. Neuronal synapse as a memristor: modeling pair-and triplet-based STDP rule. IEEE Trans. Biomed. Circuits Syst. 9, 87–95 (2014).
pubmed: 24960611
doi: 10.1109/TBCAS.2014.2318012
pmcid: 24960611
Lawlor, M. & Zucker, S. W. Feedforward learning of mixture models. Adv. Neural Inf. Process. Syst. 3, 2564–2572 (2014).
Udeigwe, L. C., Munro, P. W. & Ermentrout, G. B. Emergent dynamical properties of the BCM learning rule. J. Math. Neurosci. 7, 2 (2017).
pubmed: 28220467
pmcid: 5318375
doi: 10.1186/s13408-017-0044-6