Tree-based machine learning performed in-memory with memristive analog CAM.


Journal

Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555

Informations de publication

Date de publication:
04 10 2021
Historique:
received: 04 03 2021
accepted: 01 09 2021
entrez: 5 10 2021
pubmed: 6 10 2021
medline: 6 10 2021
Statut: epublish

Résumé

Tree-based machine learning techniques, such as Decision Trees and Random Forests, are top performers in several domains as they do well with limited training datasets and offer improved interpretability compared to Deep Neural Networks (DNN). However, these models are difficult to optimize for fast inference at scale without accuracy loss in von Neumann architectures due to non-uniform memory access patterns. Recently, we proposed a novel analog content addressable memory (CAM) based on emerging memristor devices for fast look-up table operations. Here, we propose for the first time to use the analog CAM as an in-memory computational primitive to accelerate tree-based model inference. We demonstrate an efficient mapping algorithm leveraging the new analog CAM capabilities such that each root to leaf path of a Decision Tree is programmed into a row. This new in-memory compute concept for enables few-cycle model inference, dramatically increasing 10

Identifiants

pubmed: 34608133
doi: 10.1038/s41467-021-25873-0
pii: 10.1038/s41467-021-25873-0
pmc: PMC8490381
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

5806

Informations de copyright

© 2021. The Author(s).

Références

Adv Mater. 2020 Sep;32(37):e2003437
pubmed: 32761709
Nature. 2020 Dec;588(7839):604-609
pubmed: 33361790
Nat Mach Intell. 2020 Jan;2(1):56-67
pubmed: 32607472
Nat Nanotechnol. 2017 Aug;12(8):784-789
pubmed: 28530717
Proc Natl Acad Sci U S A. 2019 Mar 5;116(10):4123-4128
pubmed: 30782810
Nature. 2018 Jun;558(7708):60-67
pubmed: 29875487
Nat Commun. 2018 Jun 19;9(1):2385
pubmed: 29921923
Nature. 2008 May 1;453(7191):80-3
pubmed: 18451858
Nature. 2020 Jan;577(7792):641-646
pubmed: 31996818
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Nat Commun. 2020 Apr 2;11(1):1638
pubmed: 32242006
Nat Biomed Eng. 2018 Oct;2(10):749-760
pubmed: 31001455

Auteurs

Giacomo Pedretti (G)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA. giacomo.pedretti@hpe.com.

Catherine E Graves (CE)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA. catherine.graves@hpe.com.

Sergey Serebryakov (S)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA.

Ruibin Mao (R)

The University of Hong Kong, Hong Kong SAR, China.

Xia Sheng (X)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA.

Martin Foltin (M)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA.

Can Li (C)

Hewlett Packard Labs, Hewlett Packard Enterprise, Milpitas, CA, USA.
The University of Hong Kong, Hong Kong SAR, China.

John Paul Strachan (JP)

Peter Grünberg Institute (PGI-14), Forschungszentrum Jülich GmbH, Jülich, Germany. j.strachan@fz-juelich.de.
RWTH Aachen University, Aachen, Germany. j.strachan@fz-juelich.de.

Classifications MeSH