Efficient ANN-SNN Conversion with Error Compensation Learning
Chang Liu, Jiangrong Shen, Xuming Ran, Mingkun Xu, Qi Xu, Yi Xu, Gang Pan
摘要
Artificial neural networks (ANNs) have demonstrated outstanding performance in numerous tasks, but deployment in resource-constrained environments remains a challenge due to their high computational and memory requirements. Spiking neural networks (SNNs) operate through discrete spike events and offer superior energy efficiency, providing a bio-inspired alternative. However, current ANN-to-SNN conversion often results in significant accuracy loss and increased inference time due to conversion errors such as clipping, quantization, and uneven activation. This paper proposes a novel ANNto-SNN conversion framework based on error compensation learning. We introduce a learnable threshold clipping function, dual-threshold neurons, and an optimized membrane potential initialization strategy to mitigate the conversion error. Together, these techniques address the clipping error through adaptive thresholds, dynamically reduce the quantization error through dual-threshold neurons, and minimize the non-uniformity error by effectively managing the membrane potential. Experimental results on CIFAR-10, CIFAR-100, ImageNet datasets show that our method achieves high-precision and ultra-low latency among existing conversion methods. Using only two time steps, our method significantly reduces the inference time while maintains competitive accuracy of 94.75% on CIFAR-10 dataset under ResNet-18 structure. This research promotes the practical application of SNNs on low-power hardware, making effi-
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Beyond Linear Processing: Dendritic Bilinear Integration in Spiking Neural NetworksJingyang Ma, Chongming Liu, Songting Li, Douglas ZhouICLR 2026
- Temporal Representation Enhancement (TRE): Learning to Forget Dominant Patterns for Enhanced Temporal Spiking FeaturesWei Liu, Li Yang, Yufei Wang, Han Xiao 等CVPR 2026
- High-Fidelity ANN-to-SNN Conversion via Closed-Loop CKA DistillationBozhou Li, Chubo Liu, Yan Ding, Yufeng Zhang 等ICML 2026
- Pseudo-Spiking Neurons: A Noise-Based Training Framework for Heterogeneous-Latency Spiking Neural NetworksYuxuan Zhang, Yuhang Sun, Hongjue Li, Yue Deng 等AAAI 2026
它引用的顶会 Paper16
- Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent BackpropagationNitin Rathi, Gopalakrishnan Srinivasan, Priyadarshini Panda, Kaushik RoyICLR 2020 · 被引用 347 次
- Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural NetworksTong Bu, Wei Fang, Jianhao Ding, Penglin Dai 等ICLR 2022 · 被引用 272 次
- Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural NetworksWenrui Zhang, Peng LiNeurIPS 2020 · 被引用 264 次
- A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks CalibrationYuhang Li, Shikuang Deng, Xin Dong, Ruihao Gong 等ICML 2021 · 被引用 239 次
- Optimized Potential Initialization for Low-Latency Spiking Neural NetworksTong Bu, Jianhao Ding, Zhaofei Yu, Tiejun HuangAAAI 2022 · 被引用 112 次
相关 Paper
- Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking CalculationZecheng Hao, Qichao Ma, Kang Chen, Yi Zhang 等ICML 2025
- Efficient Converted Spiking Neural Network for 3D and 2D ClassificationYuxiang Lan, Yachao Zhang, Xu Ma, Yanyun Qu 等ICCV 2023 · 被引用 19 次
- A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing RatesHaiyan Jiang, Srinivas Anumasa, Giulia De Masi, Huan Xiong 等ICML 2023 · 被引用 37 次
- Reducing ANN-SNN Conversion Error through Residual Membrane PotentialZecheng Hao, Tong Bu, Jianhao Ding, Tiejun Huang 等AAAI 2023 · 被引用 85 次
- Bridging the Gap between ANNs and SNNs by Calibrating Offset SpikesZecheng Hao, Jianhao Ding, Tong Bu, Tiejun Huang 等ICLR 2023 · 被引用 11 次
