Adaptive deep spiking neural network with global-local learning via balanced excitatory and inhibitory mechanism
Tingting Jiang, Qi Xu, Xuming Ran, Jiangrong Shen, Pan Lv, Qiang Zhang, Gang Pan
摘要
The training method of Spiking Neural Networks (SNNs) is an essential problem, and how to integrate local and global learning is a worthy research interest. However, the current integration methods do not consider the network conditions suitable for local and global learning and thus fail to balance their advantages. In this paper, we propose an Excitation-Inhibition Mechanism-assisted Hybrid Learning (EIHL) algorithm that adjusts the network connectivity by using the excitationinhibition mechanism and then switches between local and global learning according to the network connectivity. The experimental results on CIFAR10/100 and DVS-CIFAR10 demonstrate that the EIHL not only obtains better accuracy performance than other methods but also has excellent sparsity advantage. Especially, the Spiking VGG11 is trained by EIHL, STBP, and STDP on DVS CIFAR10, respectively. The accuracy of the Spiking VGG11 model with EIHL is 62.45%, which is 4.35% higher than STBP and 11.40% higher than STDP. Furthermore, the sparsity achieves 18.74%, which is quite higher than the above two non-sparse methods. Moreover, the excitation-inhibition mechanism used in our method also offers a new perspective on the field of SNN learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Towards efficient deep spiking neural networks construction with spiking activity based pruningYaxin Li, Qi Xu, Jiangrong Shen, Hongming Xu 等ICML 2024 · 被引用 18 次
- BIG-FUSION: Brain-Inspired Global-Local Context Fusion Framework for Multimodal Emotion Recognition in ConversationsYusong Wang, Xuanye Fang, Huifeng Yin, Dongyuan Li 等AAAI 2025 · 被引用 11 次
- Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion EfficiencyYuhong Chen, Ailin Song, Huifeng Yin, Shuai Zhong 等AAAI 2025 · 被引用 1 次
- Improving the Sparse Structure Learning of Spiking Neural Networks from the View of Compression EfficiencyJiangrong Shen, Qi Xu, Gang Pan, Badong ChenICLR 2025
- BTSP-CAM: A Brain-Inspired Geometric Memory for Class-Incremental LearningZheng Zhang, Jiaye Yang, Qingjie Guo, Jiangrong Shen 等ICML 2026
它引用的顶会 Paper4
- Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural NetworksQi Xu, Yuyuan Gao, Jiangrong Shen, Yaxin Li 等NeurIPS 2023 · 被引用 30 次
- EICIL: Joint Excitatory Inhibitory Cycle Iteration Learning for Deep Spiking Neural NetworksZihang Shao, Xuanye Fang, Yaxin Li, Chaoran Feng 等NeurIPS 2023 · 被引用 15 次
- Why do networks have inhibitory/negative connections?Qingyang Wang, Michael A. Powell, Ali Geisa, Eric Bridgeford 等ICCV 2023 · 被引用 10 次
- RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural NetworkBing Han, Gopalakrishnan Srinivasan, Kaushik RoyCVPR 2020
相关 Paper
- ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural NetworksJiangrong Shen, Qi Xu, Jian K. Liu, Yueming Wang 等AAAI 2023 · 被引用 64 次
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier 等ICCV 2021 · 被引用 731 次
- A Progressive Training Framework for Spiking Neural Networks with Learnable Multi-hierarchical ModelZecheng Hao, Xinyu Shi, Zihan Huang, Tong Bu 等ICLR 2024 · 被引用 16 次
- Reversing Structural Pattern Learning with Biologically Inspired Knowledge Distillation for Spiking Neural NetworksQi Xu, Yaxin Li, Xuanye Fang, Jiangrong Shen 等ACM MM 2024 · 被引用 12 次
- Brain-inspired Multilayer Perceptron with Spiking NeuronsWenshuo Li, Hanting Chen, Jianyuan Guo, Ziyang Zhang 等CVPR 2022 · 被引用 37 次
