FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorization
Yifei Zhou, Xuchu Huang, Chenyu Ni, Min Zhou, Zheyu Yan, Xunzhao Yin, Cheng Zhuo
Abstract
Neuro-symbolic artificial intelligence (neurosymbolic AI) excels in logical analysis and reasoning. Hyperdimensional Computing (HDC), a promising braininspired computational model, is integral to neuro-symbolic AI. Various HDC models have been proposed to represent class-instance and class-class relations, but when representing the more complex class-subclass relation, where multiple objects associate different levels of classes and subclasses, they face challenges for factorization, a crucial task for neuro-symbolic AI systems. In this article, we propose FactorHD, a novel HDC model capable of representing and factorizing the complex class-subclass relation efficiently. FactorHD features a symbolic encoding method that embeds an extra memorization clause, preserving more information for multiple objects. In addition, it employs an efficient factorization algorithm that selectively eliminates redundant classes by identifying the memorization clause of the target class. Such model significantly enhances computing efficiency and accuracy in representing and factorizing multiple objects with class-subclass relation, overcoming limitations of existing HDC models such as “superposition catastrophe” and “the problem of 2 “. Evaluations show that FactorHD achieves approximately speedup at a representation size of compared to existing HDC models. When integrated with the ResNet-18 neural network, FactorHD achieves factorization accuracy on the Cifar-10 dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 175a3288-ed48-4cf2-b88c-23646ecf80d2Builds on2
- Understanding Hyperdimensional Computing for Parallel Single-Pass LearningTao Yu, Yichi Zhang, Zhiru Zhang, Christopher De SaNeurIPS 2022 · 56 citations
- MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in SuperpositionNicolas Menet, Michael Hersche, Geethan Karunaratne, Luca Benini et al.NeurIPS 2023 · 32 citations
Related papers
- Comprehensive Integration of Hyperdimensional Computing with Deep Learning towards Neuro-Symbolic AIHyunsei Lee, Jiseung Kim, Hanning Chen, Ariela Zeira et al.DAC 2023 · 12 citations
- HDQMF: Holographic Feature Decomposition using Quantum AlgorithmsPrathyush Poduval, Zhuowen Zou, Mohsen ImaniCVPR 2024 · 2 citations
- CascadeHD: Efficient Many-Class Learning Framework Using Hyperdimensional ComputingYeseong Kim, Jiseung Kim, Mohsen ImaniDAC 2021 · 17 citations
- StocHD: Stochastic Hyperdimensional System for Efficient and Robust Learning from Raw DataPrathyush Poduval, Zhuowen Zou, M. Hassan Najafi, Houman Homayoun et al.DAC 2021 · 34 citations
- Scalable edge-based hyperdimensional learning system with brain-like neural adaptationZhuowen Zou, Yeseong Kim, Farhad Imani, Haleh Alimohamadi et al.SC 2021 · 70 citations
