Tree-based machine learning performed in-memory with memristive analog CAM.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
04 10 2021
04 10 2021
Historique:
received:
04
03
2021
accepted:
01
09
2021
entrez:
5
10
2021
pubmed:
6
10
2021
medline:
6
10
2021
Statut:
epublish
Résumé
Tree-based machine learning techniques, such as Decision Trees and Random Forests, are top performers in several domains as they do well with limited training datasets and offer improved interpretability compared to Deep Neural Networks (DNN). However, these models are difficult to optimize for fast inference at scale without accuracy loss in von Neumann architectures due to non-uniform memory access patterns. Recently, we proposed a novel analog content addressable memory (CAM) based on emerging memristor devices for fast look-up table operations. Here, we propose for the first time to use the analog CAM as an in-memory computational primitive to accelerate tree-based model inference. We demonstrate an efficient mapping algorithm leveraging the new analog CAM capabilities such that each root to leaf path of a Decision Tree is programmed into a row. This new in-memory compute concept for enables few-cycle model inference, dramatically increasing 10
Identifiants
pubmed: 34608133
doi: 10.1038/s41467-021-25873-0
pii: 10.1038/s41467-021-25873-0
pmc: PMC8490381
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
5806Informations de copyright
© 2021. The Author(s).
Références
Adv Mater. 2020 Sep;32(37):e2003437
pubmed: 32761709
Nature. 2020 Dec;588(7839):604-609
pubmed: 33361790
Nat Mach Intell. 2020 Jan;2(1):56-67
pubmed: 32607472
Nat Nanotechnol. 2017 Aug;12(8):784-789
pubmed: 28530717
Proc Natl Acad Sci U S A. 2019 Mar 5;116(10):4123-4128
pubmed: 30782810
Nature. 2018 Jun;558(7708):60-67
pubmed: 29875487
Nat Commun. 2018 Jun 19;9(1):2385
pubmed: 29921923
Nature. 2008 May 1;453(7191):80-3
pubmed: 18451858
Nature. 2020 Jan;577(7792):641-646
pubmed: 31996818
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Nat Commun. 2020 Apr 2;11(1):1638
pubmed: 32242006
Nat Biomed Eng. 2018 Oct;2(10):749-760
pubmed: 31001455