Pseudo-Spiking Neurons: A Noise-Based Training Framework for Heterogeneous-Latency Spiking Neural Networks
Yuxuan Zhang, Yuhang Sun, Hongjue Li, Yue Deng, Wen Yao
Abstract
Spiking Neural Networks (SNNs) promise significant energy efficiency by processing information via sparse, event-driven spikes. However, realizing this potential is hindered by the conventional use of a rigid, uniform timestep, T . This constraint imposes a challenging trade-off between accuracy and latency, while also incurring the prohibitive training costs of Backpropagation Through Time (BPTT). To overcome this limitation, we introduce the Pseudo-Spiking Neuron (Pseu-doSN), a novel training proxy that conceptualizes latency as an intrinsic, learnable parameter for each neuron. Building on the efficiency of rate-based methods, the PseudoSN models temporal dynamics in a single, BPTT-free pass. It employs a learnable probabilistic noise scheme to emulate the discretization effects of spike generation (e.g., clipping and quantization), making the neuron-specific timestep-and thus latency-directly optimizable via backpropagation. Integrated into a hardware-aware objective, our framework trains heterogeneous-latency SNNs that autonomously learn to optimize the trade-offs among accuracy, latency and energy, establishing a new state-of-the-art on major benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f240640a-8430-46aa-9e7c-ea45d6f40362Builds on21
- Deep Residual Learning in Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang et al.NeurIPS 2021 · 857 citations
- Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural NetworksTong Bu, Wei Fang, Jianhao Ding, Penglin Dai et al.ICLR 2022 · 272 citations
- Deep Directly-Trained Spiking Neural Networks for Object DetectionQiaoyi Su, Yuhong Chou, Yifan Hu, Jianing Li et al.ICCV 2023 · 143 citations
- Online Training Through Time for Spiking Neural NetworksMingqing Xiao, Qingyan Meng, Zongpeng Zhang, Di He et al.NeurIPS 2022 · 121 citations
- Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term DependenciesWei Fang, Zhaofei Yu, Zhaokun Zhou, Ding Chen et al.NeurIPS 2023 · 104 citations
Related papers
- Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike RepresentationQingyan Meng, Mingqing Xiao, Shen Yan, Yisen Wang et al.CVPR 2022 · 114 citations
- Enhancing Training of Spiking Neural Network with Stochastic LatencySrinivas Anumasa, Bhaskar Mukhoty, Velibor Bojkovic, Giulia De Masi et al.AAAI 2024 · 17 citations
- Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural NetworksQingyan Meng, Mingqing Xiao, Shen Yan, Yisen Wang et al.ICCV 2023 · 84 citations
- Skipper: Enabling efficient SNN training through activation-checkpointing and time-skippingSonali Singh, Anup Sarma, Sen Lu, Abhronil Sengupta et al.MICRO 2022 · 13 citations
- Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking CalculationZecheng Hao, Qichao Ma, Kang Chen, Yi Zhang et al.ICML 2025
