A Brain-Inspired Homeostatic Neuron Based on Phase-Change Memories for Efficient Neuromorphic Computing.
brain-inspired computing
hardware resilience
homeostatic scaling
phase change memory
reinforcement learning
spike-timing-dependent plasticity
synaptic scaling
unsupervised learning
Journal
Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481
Informations de publication
Date de publication:
2021
2021
Historique:
received:
13
05
2021
accepted:
27
07
2021
entrez:
7
9
2021
pubmed:
8
9
2021
medline:
8
9
2021
Statut:
epublish
Résumé
One of the main goals of neuromorphic computing is the implementation and design of systems capable of dynamic evolution with respect to their own experience. In biology, synaptic scaling is the homeostatic mechanism which controls the frequency of neural spikes within stable boundaries for improved learning activity. To introduce such control mechanism in a hardware spiking neural network (SNN), we present here a novel artificial neuron based on phase change memory (PCM) devices capable of internal regulation via homeostatic and plastic phenomena. We experimentally show that this mechanism increases the robustness of the system thus optimizing the multi-pattern learning under spike-timing-dependent plasticity (STDP). It also improves the continual learning capability of hybrid supervised-unsupervised convolutional neural networks (CNNs), in terms of both resilience and accuracy. Furthermore, the use of neurons capable of self-regulating their fire responsivity as a function of the PCM internal state enables the design of dynamic networks. In this scenario, we propose to use the PCM-based neurons to design bio-inspired recurrent networks for autonomous decision making in navigation tasks. The agent relies on neuronal spike-frequency adaptation (SFA) to explore the environment via penalties and rewards. Finally, we show that the conductance drift of the PCM devices, contrarily to the applications in neural network accelerators, can improve the overall energy efficiency of neuromorphic computing by implementing bio-plausible active forgetting.
Identifiants
pubmed: 34489628
doi: 10.3389/fnins.2021.709053
pmc: PMC8417123
doi:
Types de publication
Journal Article
Langues
eng
Pagination
709053Informations de copyright
Copyright © 2021 Muñoz-Martin, Bianchi, Hashemkhani, Pedretti, Melnic and Ielmini.
Déclaration de conflit d'intérêts
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Références
Trends Neurosci. 2005 Feb;28(2):73-8
pubmed: 15667929
Front Neurosci. 2014 Jul 22;8:205
pubmed: 25100936
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Nat Nanotechnol. 2016 Aug;11(8):693-9
pubmed: 27183057
Front Neurosci. 2020 Apr 30;14:379
pubmed: 32425749
Nature. 2016 Jan 28;529(7587):484-9
pubmed: 26819042
Philos Trans R Soc Lond B Biol Sci. 2017 Mar 5;372(1715):
pubmed: 28093560
Neural Comput. 2000 Jan;12(1):219-45
pubmed: 10636940
PLoS Comput Biol. 2007 Feb 16;3(2):e31
pubmed: 17305422
IEEE Trans Biomed Circuits Syst. 2019 Jun;13(3):579-591
pubmed: 30932847
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
Nat Commun. 2020 May 18;11(1):2473
pubmed: 32424184
IEEE Trans Biomed Circuits Syst. 2017 Dec;11(6):1271-1277
pubmed: 29293423
Cell. 2008 Oct 31;135(3):422-35
pubmed: 18984155
Sci Rep. 2017 Jul 13;7(1):5288
pubmed: 28706303
Front Neurosci. 2011 May 31;5:73
pubmed: 21747754
Proc Mach Learn Res. 2017;70:3987-3995
pubmed: 31909397
Philos Trans R Soc Lond B Biol Sci. 2017 Mar 5;372(1715):
pubmed: 28093558
Neural Netw. 2019 May;113:54-71
pubmed: 30780045
PLoS Comput Biol. 2013 Apr;9(4):e1003024
pubmed: 23592970
Trends Neurosci. 1999 May;22(5):221-7
pubmed: 10322495
Nanotechnology. 2013 Sep 27;24(38):382001
pubmed: 23999572
Neuron. 2017 Aug 2;95(3):490-503
pubmed: 28772119
Front Neurosci. 2016 Mar 08;10:56
pubmed: 27013934