Sparse Coding Using the Locally Competitive Algorithm on the TrueNorth Neurosynaptic System.

TrueNorth brain-inspired sparse-approximation sparse-code sparsity spiking-neurons

Journal

Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481

Informations de publication

Date de publication:
2019
Historique:
received: 07 09 2018
accepted: 08 07 2019
entrez: 10 8 2019
pubmed: 10 8 2019
medline: 10 8 2019
Statut: epublish

Résumé

The Locally Competitive Algorithm (LCA) is a biologically plausible computational architecture for sparse coding, where a signal is represented as a linear combination of elements from an over-complete dictionary. In this paper we map the LCA algorithm on the brain-inspired, IBM TrueNorth Neurosynaptic System. We discuss data structures and representation as well as the architecture of functional processing units that perform non-linear threshold, vector-matrix multiplication. We also present the design of the micro-architectural units that facilitate the implementation of dynamical based iterative algorithms. Experimental results with the LCA algorithm using the limited precision, fixed-point arithmetic on TrueNorth compare favorably with results using floating-point computations on a general purpose computer. The scaling of the LCA algorithm within the constraints of the TrueNorth is also discussed.

Identifiants

pubmed: 31396039
doi: 10.3389/fnins.2019.00754
pmc: PMC6664083
doi:

Types de publication

Journal Article

Langues

eng

Pagination

754

Références

Curr Opin Neurobiol. 2004 Aug;14(4):481-7
pubmed: 15321069
Neural Comput. 2008 Oct;20(10):2526-63
pubmed: 18439138
Neural Netw. 2013 Sep;45:134-43
pubmed: 23582485
IEEE Trans Image Process. 2013 Aug;22(8):3234-46
pubmed: 23674456
Neural Netw. 2013 Sep;45:4-26
pubmed: 23886551
Proc Natl Acad Sci U S A. 2013 Sep 24;110(39):15512-3
pubmed: 24029019
IEEE Trans Neural Netw Learn Syst. 2012 Sep;23(9):1377-89
pubmed: 24199030
Int J Neural Syst. 2014 Aug;24(5):1440001
pubmed: 24875786
Science. 2014 Aug 8;345(6197):668-73
pubmed: 25104385
Nat Nanotechnol. 2017 Aug;12(8):722-723
pubmed: 28530716
Nat Nanotechnol. 2017 Aug;12(8):784-789
pubmed: 28530717
J Opt Soc Am A. 1987 Dec;4(12):2379-94
pubmed: 3430225
Nature. 1996 Jun 13;381(6583):607-9
pubmed: 8637596

Auteurs

Kaitlin L Fair (KL)

School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States.

Daniel R Mendat (DR)

Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, United States.

Andreas G Andreou (AG)

Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, United States.

Christopher J Rozell (CJ)

School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States.

Justin Romberg (J)

School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States.

David V Anderson (DV)

School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States.

Classifications MeSH