Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
Yongqi Ding, Kunshan Yang, Linze Li, Yiyang Zhang, Mengmeng Jing, Lin Zuo
Abstract
Although the temporal spike dynamics of spiking neural networks (SNNs) enable low-power temporal pattern capture capabilities, they also incur inherent inconsistencies that severely compromise representation. In this paper, we perform dual consistency optimization via Stable Spike to mitigate this problem, thereby improving the recognition performance of SNNs. With the hardware-friendly "AND" bit operation, we efficiently decouple the stable spike skeleton from the multi-timestep spike maps, thereby capturing critical semantics while reducing inconsistencies from variable noise spikes. Enforcing the unstable spike maps to converge to the stable spike skeleton significantly improves the inherent consistency across timesteps. Furthermore, we inject amplitude-aware spike noise into the stable spike skeleton to diversify the representations while preserving consistent semantics. The SNN is encouraged to produce perturbationconsistent predictions, thereby contributing to generalization. Extensive experiments across multiple architectures and datasets validate the effectiveness and versatility of our method. In particular, our method significantly advances neuromorphic object recognition under ultra-low latency, improving accuracy by up to 8.33%. This will help unlock the full power consumption and speed potential of SNNs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on29
- Spike-driven TransformerMan Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan et al.NeurIPS 2023 · 368 citations
- A Simple Feature Augmentation for Domain GeneralizationPan Li, Da Li, Wei Li, Shaogang Gong et al.ICCV 2021 · 242 citations
- QKFormer: Hierarchical Spiking Transformer using Q-K AttentionChenlin Zhou, Han Zhang, Zhaokun Zhou, Liutao Yu et al.NeurIPS 2024 · 126 citations
- Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term DependenciesWei Fang, Zhaofei Yu, Zhaokun Zhou, Ding Chen et al.NeurIPS 2023 · 104 citations
- Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential LearningWachirawit Ponghiran, Kaushik RoyAAAI 2022 · 60 citations
Related papers
- Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural NetworksYongqi Ding, Lin Zuo, Mengmeng Jing, Pei He et al.AAAI 2024 · 36 citations
- Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural NetworksXian Zhong, Shengwang Hu, Wenxuan Liu, Wenxin Huang et al.ACM MM 2024 · 5 citations
- Temporal Dynamics Enhancer for Directly Trained Spiking Object DetectorsFan Luo, Zeyu Gao, Xinhao Luo, Kai Zhao et al.AAAI 2026
- Temporal Representation Enhancement (TRE): Learning to Forget Dominant Patterns for Enhanced Temporal Spiking FeaturesWei Liu, Li Yang, Yufei Wang, Han Xiao et al.CVPR 2026
- Noise-Robust Deep Spiking Neural Networks with Temporal InformationSeongsik Park, Dongjin Lee, Sungroh YoonDAC 2021 · 17 citations
