Voltage-dependent synaptic plasticity: Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential.
Hebbian plasticity
STDP
modified national institute of standards and technology database (MNIST)
spiking neural networks
synaptic plasticity
unsupervised learning
Journal
Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481
Informations de publication
Date de publication:
2022
2022
Historique:
received:
01
07
2022
accepted:
05
09
2022
entrez:
7
11
2022
pubmed:
8
11
2022
medline:
8
11
2022
Statut:
epublish
Résumé
This study proposes voltage-dependent-synaptic plasticity (VDSP), a novel brain-inspired unsupervised local learning rule for the online implementation of Hebb's plasticity mechanism on neuromorphic hardware. The proposed VDSP learning rule updates the synaptic conductance on the spike of the postsynaptic neuron only, which reduces by a factor of two the number of updates with respect to standard spike timing dependent plasticity (STDP). This update is dependent on the membrane potential of the presynaptic neuron, which is readily available as part of neuron implementation and hence does not require additional memory for storage. Moreover, the update is also regularized on synaptic weight and prevents explosion or vanishing of weights on repeated stimulation. Rigorous mathematical analysis is performed to draw an equivalence between VDSP and STDP. To validate the system-level performance of VDSP, we train a single-layer spiking neural network (SNN) for the recognition of handwritten digits. We report 85.01 ± 0.76% (Mean ± SD) accuracy for a network of 100 output neurons on the MNIST dataset. The performance improves when scaling the network size (89.93 ± 0.41% for 400 output neurons, 90.56 ± 0.27 for 500 neurons), which validates the applicability of the proposed learning rule for spatial pattern recognition tasks. Future work will consider more complicated tasks. Interestingly, the learning rule better adapts than STDP to the frequency of input signal and does not require hand-tuning of hyperparameters.
Identifiants
pubmed: 36340782
doi: 10.3389/fnins.2022.983950
pmc: PMC9634260
doi:
Types de publication
Journal Article
Langues
eng
Pagination
983950Informations de copyright
Copyright © 2022 Garg, Balafrej, Stewart, Portal, Bocquet, Querlioz, Drouin, Rouat, Beilliard and Alibart.
Déclaration de conflit d'intérêts
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Références
Nature. 1990 Sep 6;347(6288):69-72
pubmed: 1975639
IEEE Trans Biomed Circuits Syst. 2017 Feb;11(1):128-142
pubmed: 28113678
Neural Comput. 2007 Nov;19(11):2881-912
pubmed: 17883345
PLoS Comput Biol. 2015 Nov 06;11(11):e1004588
pubmed: 26544038
Front Comput Neurosci. 2010 Sep 10;4:
pubmed: 20890448
J Neurosci. 2000 Dec 1;20(23):8812-21
pubmed: 11102489
Sci Rep. 2018 Jun 19;8(1):9367
pubmed: 29921840
Front Neurosci. 2016 Mar 08;10:56
pubmed: 27013934
Brain Res Bull. 1999 Nov-Dec;50(5-6):303-4
pubmed: 10643408
Nat Neurosci. 2010 Mar;13(3):344-52
pubmed: 20098420
Neural Netw. 2021 Feb;134:64-75
pubmed: 33291017
Neural Netw. 2018 Mar;99:56-67
pubmed: 29328958
Front Neurosci. 2019 Aug 06;13:812
pubmed: 31447634
IEEE Trans Pattern Anal Mach Intell. 2020 Aug;42(8):2051-2064
pubmed: 30843817
Biol Cybern. 2008 Jun;98(6):459-78
pubmed: 18491160
Front Neurosci. 2018 Aug 03;12:435
pubmed: 30123103
Front Neurosci. 2013 Feb 18;7:2
pubmed: 23423540
Nature. 1993 Jan 7;361(6407):31-9
pubmed: 8421494
Front Comput Neurosci. 2015 Aug 03;9:99
pubmed: 26941637
Neural Comput. 2004 Oct;16(10):2101-24
pubmed: 15333209
J Neurosci. 1998 Dec 15;18(24):10464-72
pubmed: 9852584
PLoS Comput Biol. 2021 Mar 25;17(3):e1008866
pubmed: 33764970
Nat Commun. 2018 Jun 28;9(1):2514
pubmed: 29955057
PLoS Comput Biol. 2007 Feb 16;3(2):e31
pubmed: 17305422
Front Neuroinform. 2014 Jan 06;7:48
pubmed: 24431999
Nanotechnology. 2019 Oct 25;30(43):435206
pubmed: 31342921
Nat Neurosci. 2000 Sep;3(9):919-26
pubmed: 10966623