Temporal Weighted Encoding: Towards Maximal-Capacity Spike Coding for ANN–SNN Conversion
Yiwen Gu, Junchuan Gu, Haibin Shen, Kejie Huang
Abstract
Spiking Neural Networks (SNNs) emulate the spiking behavior of biological neurons and are promising for energy-efficient neuromorphic computing. A widely used strategy to train SNNs is to convert pretrained Artificial Neural Networks (ANNs), where the accuracy and efficiency are determined by the spike encoding scheme. Traditional methods based on spike count or timing severely underutilize the available encoding space, leading to large accuracy degradation under low-timestep constraints. More expressive alternatives involve complex dynamics, which hinder scalability and practical deployment. To address these challenges, we propose Temporal Weighted Encoding (TWE). Spikes are implicitly assigned exponentially decaying weights through a recursive integration, drawing an analogy to a temporal bit sequence. We systematically analyze the temporal mismatch caused by this weight pattern and propose temporal relaxation and threshold relaxation to resolve this issue, enabling fast and accurate activation encoding. Extensive experiments demonstrate that TWE achieves negligible conversion loss with significantly fewer timesteps, offering a scalable and efficient solution for SNN deployment.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0be9eaa4-619d-4185-9650-947d6ed41be7Builds on7
- Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural NetworksTong Bu, Wei Fang, Jianhao Ding, Penglin Dai et al.ICLR 2022 · 272 citations
- Ternary Spike: Learning Ternary Spikes for Spiking Neural NetworksYufei Guo, Yuanpei Chen, Xiaode Liu, Weihang Peng et al.AAAI 2024 · 70 citations
- Towards High-performance Spiking Transformers from ANN to SNN ConversionZihan Huang, Xinyu Shi, Zecheng Hao, Tong Bu et al.ACM MM 2024 · 17 citations
- Bridging the Gap between ANNs and SNNs by Calibrating Offset SpikesZecheng Hao, Jianhao Ding, Tong Bu, Tiejun Huang et al.ICLR 2023 · 11 citations
- Adaptive Calibration: A Unified Conversion Framework of Spiking Neural NetworksZiqing Wang, Yuetong Fang, Jiahang Cao, Hongwei Ren et al.AAAI 2025 · 9 citations
Related papers
- Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural NetworksShikuang Deng, Shi GuICLR 2021 · 100 citations
- TS-SNN: Temporal Shift Module for Spiking Neural NetworksKairong Yu, Tianqing Zhang, Qi Xu, Gang Pan et al.ICML 2025
- A time-to-first-spike coding and conversion aware training for energy-efficient deep spiking neural network processor designDongwoo Lew, Kyungchul Lee, Jongsun ParkDAC 2022 · 18 citations
- A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing RatesHaiyan Jiang, Srinivas Anumasa, Giulia De Masi, Huan Xiong et al.ICML 2023 · 37 citations
- Exploring Loss Functions for Time-based Training Strategy in Spiking Neural NetworksYaoyu Zhu, Wei Fang, Xiaodong Xie, Tiejun Huang et al.NeurIPS 2023 · 26 citations
