Temporal Representation Enhancement (TRE): Learning to Forget Dominant Patterns for Enhanced Temporal Spiking Features
Wei Liu, Li Yang, Yufei Wang, Han Xiao, Boyu Cai, Weiming Hu
Abstract
Spiking Neural Networks (SNNs) naturally process visual inputs across multiple timesteps, offering rich temporal dynamics and energy-efficient computation. However, the temporally invariant supervision commonly used in training tends to reinforce the same dominant response patterns across timesteps, leading to redundant representations and limiting temporal discriminability. To overcome this limitation, we introduce Temporal Representation Enhancement (TRE), a novel learning-to-forget paradigm that encourages more diverse and complementary temporal representations. TRE identifies high-contribution semantic patterns through class-specific contribution estimation and temporal accumulation, and selectively suppresses them using a dynamic modulation strategy. By redirecting the model's attention toward alternative yet informative semantic cues, TRE promotes the learning of complementary features across timesteps. This approach not only strengthens the temporal discriminative capacity of SNNs but also enables more effective multi-timestep learning by leveraging richer semantic information. Extensive experiments on both static image datasets and dynamic neuromorphic datasets demonstrate that TRE consistently improves classification accuracy and feature diversity across different SNN backbones.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d1bd8b0-d0fa-47d9-9b06-e8698972cedcBuilds on28
- Deep Residual Learning in Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang et al.NeurIPS 2021 · 857 citations
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier et al.ICCV 2021 · 731 citations
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu et al.AAAI 2021 · 694 citations
- Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingShikuang Deng, Yuhang Li, Shanghang Zhang, Shi GuICLR 2022 · 361 citations
- Differentiable Spike: Rethinking Gradient-Descent for Training Spiking Neural NetworksYuhang Li, Yufei Guo, Shanghang Zhang, Shikuang Deng et al.NeurIPS 2021 · 288 citations
Related papers
- Towards More Discriminative Feature Learning in SNNs with Temporal-Self-Erasing SupervisionWei Liu, Li Yang, Mingxuan Zhao, Dengfeng Xue et al.AAAI 2025 · 1 citation
- Resolving the Timestep Scaling Paradox in Spiking Neural Networks with a Timestep-Scalable Neuron ModelBinghao Ye, Wenjuan Li, Dengfeng Xue, Bing Li et al.ICML 2026
- Temporal Dynamics Enhancer for Directly Trained Spiking Object DetectorsFan Luo, Zeyu Gao, Xinhao Luo, Kai Zhao et al.AAAI 2026
- MI-TRQR: Mutual Information-Based Temporal Redundancy Quantification and Reduction for Energy-Efficient Spiking Neural NetworksDengfeng Xue, Wenjuan Li, Yifan Lu, Chunfeng Yuan et al.NeurIPS 2025
- Temporal Weighted Encoding: Towards Maximal-Capacity Spike Coding for ANN–SNN ConversionYiwen Gu, Junchuan Gu, Haibin Shen, Kejie HuangICML 2026
