Sparse Coding Using the Locally Competitive Algorithm on the TrueNorth Neurosynaptic System.
TrueNorth
brain-inspired
sparse-approximation
sparse-code
sparsity
spiking-neurons
Journal
Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481
Informations de publication
Date de publication:
2019
2019
Historique:
received:
07
09
2018
accepted:
08
07
2019
entrez:
10
8
2019
pubmed:
10
8
2019
medline:
10
8
2019
Statut:
epublish
Résumé
The Locally Competitive Algorithm (LCA) is a biologically plausible computational architecture for sparse coding, where a signal is represented as a linear combination of elements from an over-complete dictionary. In this paper we map the LCA algorithm on the brain-inspired, IBM TrueNorth Neurosynaptic System. We discuss data structures and representation as well as the architecture of functional processing units that perform non-linear threshold, vector-matrix multiplication. We also present the design of the micro-architectural units that facilitate the implementation of dynamical based iterative algorithms. Experimental results with the LCA algorithm using the limited precision, fixed-point arithmetic on TrueNorth compare favorably with results using floating-point computations on a general purpose computer. The scaling of the LCA algorithm within the constraints of the TrueNorth is also discussed.
Identifiants
pubmed: 31396039
doi: 10.3389/fnins.2019.00754
pmc: PMC6664083
doi:
Types de publication
Journal Article
Langues
eng
Pagination
754Références
Curr Opin Neurobiol. 2004 Aug;14(4):481-7
pubmed: 15321069
Neural Comput. 2008 Oct;20(10):2526-63
pubmed: 18439138
Neural Netw. 2013 Sep;45:134-43
pubmed: 23582485
IEEE Trans Image Process. 2013 Aug;22(8):3234-46
pubmed: 23674456
Neural Netw. 2013 Sep;45:4-26
pubmed: 23886551
Proc Natl Acad Sci U S A. 2013 Sep 24;110(39):15512-3
pubmed: 24029019
IEEE Trans Neural Netw Learn Syst. 2012 Sep;23(9):1377-89
pubmed: 24199030
Int J Neural Syst. 2014 Aug;24(5):1440001
pubmed: 24875786
Science. 2014 Aug 8;345(6197):668-73
pubmed: 25104385
Nat Nanotechnol. 2017 Aug;12(8):722-723
pubmed: 28530716
Nat Nanotechnol. 2017 Aug;12(8):784-789
pubmed: 28530717
J Opt Soc Am A. 1987 Dec;4(12):2379-94
pubmed: 3430225
Nature. 1996 Jun 13;381(6583):607-9
pubmed: 8637596