Narrowing the ANN–SNN Gap for Continuous 1D Temporal Signal Classification with Multi-Scale Temporal Encoding and Sparsity-Regularized Transform Encoding
Qi Sun, Yulei Huang, Zhen Cao, Biao Hou
摘要
Spiking neural networks (SNNs) promise energyefficient inference, yet on static vision benchmarks, they often trail matched ANNs under short simulation horizons. Under a matchedbackbone and matched-budget protocol without extra tricks, we find that this ANN-SNN accuracy gap is consistently smaller on representative continuous 1D temporal signal classification benchmarks than on image benchmarks. We attribute this to a mechanism-level mismatch: leaky integration naturally implements causal evidence accumulation over time for native temporal signals, while static images typically require amplitude-to-spike encoding, whose finitewindow estimation error becomes non-negligible at short horizons. Guided by this view, we propose a plug-and-play framework that combines Multi-Scale Temporal Encoding (MTE) and Sparsity-Regularized Transform Encoding (STE). MTE replaces naive repetition with multi-scale streams and allocates scale-aligned multi-bit integer spikes to increase per-step information density, and STE replaces a controllable fraction of LIF units with a transform-encoding neuron trained using auxiliary reconstruction and sparsity regularization, with a synthesis branch used only during training. Across diverse 1D datasets and backbone families, MTE×STE consistently improves the accuracy-efficiency trade-off over standard SNN baselines and matches or occasionally surpasses ANN counterparts. The source code is available at https://github.com/ Sun7-7/Signal_Code_SNN
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Deep Residual Learning in Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang 等NeurIPS 2021 · 被引用 857 次
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu 等AAAI 2021 · 被引用 694 次
- Spikformer: When Spiking Neural Network Meets TransformerZhaokun Zhou, Yuesheng Zhu, Chao He, Yaowei Wang 等ICLR 2023 · 被引用 103 次
- Spiking Convolutional Neural Networks for Text ClassificationChangze Lv, Jianhan Xu, Xiaoqing ZhengICLR 2023 · 被引用 8 次
相关 Paper
- SpikeCLR: Self-Supervised Contrastive Learning for Visual Representations with Spiking Neural NetworksChengwei Zhou, Gourav DattaICML 2026
- DCT-SNN: Using DCT to Distribute Spatial Information over Time for Low-Latency Spiking Neural NetworksIsha Garg, Sayeed Shafayet Chowdhury, Kaushik RoyICCV 2021 · 被引用 37 次
- Positional Encoding for Spiking TransformersZijian Zhou, Yu Liang, Honglin Cao, Ammar Belatreche 等ICML 2026 · 被引用 7 次
- SpikePack: Enhanced Information Flow in Spiking Neural Networks with High Hardware CompatibilityGuobin Shen, Jindong Li, Tenglong Li, Dongcheng Zhao 等ICCV 2025 · 被引用 1 次
- Spiking Transformer with Spatial-Temporal AttentionDonghyun Lee, Yuhang Li, Youngeun Kim, Shiting Xiao 等CVPR 2025
