FeKAN: Efficient Kolmogorov-Arnold Networks Accelerator Using FeFET-based CAM and LUT
Xuliang Yu, Yu Qian, Xunzhao Yin, Cheng Zhuo, Liang Zhao
摘要
Kolmogorov-Arnold networks (KANs) have emerged as a promising alternative to MLP due to their adaptive learning capabilities for complex dependencies through B-spline basis activations (BBA). However, existing in-memory accelerators optimized for MLP-based DNNs are primarily designed for vector-matrix multiplication (VMM), making them inefficient for the dynamic and recursive B-spline interpolation (BSI) operations required by KANs. In this work, we propose FeKAN, an FeFET-based architecture designed to accelerate BBA operations. First, we develop a software-hardware co-optimized framework for mapping B-spline basis functions (BBF), leveraging a two-stage design space exploration (DSE) algorithm in combination with FeFET-based Look-Up Tables (LUT) and Content-Addressable Memory (CAM). This framework translated dynamic BSI operations into static codebook lookups, achieving a balanced trade-off between memory and computational efficiency. Second, we propose compress-sparsity-column (CSC) based encoding for B-spline basis function and grouped-computation strategy for memory and energy reduction. Third, we propose a groupedpipeline optimization strategy to mitigate data dependencies, significantly enhancing computation efficiency. Experimental results demonstrate that FeKAN achieves up to and higher throughput and up to and greater energy efficiency over Intel Xeon Silver 4310 CPU and NVIDIA A6000 GPU, respectively.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- PowerMLP: An Efficient Version of KANRuichen Qiu, Yibo Miao, Shiwen Wang, Yifan Zhu 等AAAI 2025 · 被引用 13 次
- Incorporating Arbitrary Matrix Group Equivariance into KANsLexiang Hu, Yisen Wang, Zhouchen LinICML 2025
- On the expressiveness and spectral bias of KANsYixuan Wang, Jonathan W. Siegel, Ziming Liu, Thomas Y. HouICLR 2025
- Lookup multivariate Kolmogorov-Arnold NetworksSergey Pozdnyakov, Philippe SchwallerICLR 2026 · 被引用 1 次
- KAN: Kolmogorov-Arnold NetworksZiming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle 等ICLR 2025
