Adaptive deep spiking neural network with global-local learning via balanced excitatory and inhibitory mechanism
Tingting Jiang, Qi Xu, Xuming Ran, Jiangrong Shen, Pan Lv, Qiang Zhang, Gang Pan
Abstract
The training method of Spiking Neural Networks (SNNs) is an essential problem, and how to integrate local and global learning is a worthy research interest. However, the current integration methods do not consider the network conditions suitable for local and global learning and thus fail to balance their advantages. In this paper, we propose an Excitation-Inhibition Mechanism-assisted Hybrid Learning (EIHL) algorithm that adjusts the network connectivity by using the excitationinhibition mechanism and then switches between local and global learning according to the network connectivity. The experimental results on CIFAR10/100 and DVS-CIFAR10 demonstrate that the EIHL not only obtains better accuracy performance than other methods but also has excellent sparsity advantage. Especially, the Spiking VGG11 is trained by EIHL, STBP, and STDP on DVS CIFAR10, respectively. The accuracy of the Spiking VGG11 model with EIHL is 62.45%, which is 4.35% higher than STBP and 11.40% higher than STDP. Furthermore, the sparsity achieves 18.74%, which is quite higher than the above two non-sparse methods. Moreover, the excitation-inhibition mechanism used in our method also offers a new perspective on the field of SNN learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Towards efficient deep spiking neural networks construction with spiking activity based pruningYaxin Li, Qi Xu, Jiangrong Shen, Hongming Xu et al.ICML 2024 · 18 citations
- BIG-FUSION: Brain-Inspired Global-Local Context Fusion Framework for Multimodal Emotion Recognition in ConversationsYusong Wang, Xuanye Fang, Huifeng Yin, Dongyuan Li et al.AAAI 2025 · 11 citations
- Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion EfficiencyYuhong Chen, Ailin Song, Huifeng Yin, Shuai Zhong et al.AAAI 2025 · 1 citation
- Improving the Sparse Structure Learning of Spiking Neural Networks from the View of Compression EfficiencyJiangrong Shen, Qi Xu, Gang Pan, Badong ChenICLR 2025
- BTSP-CAM: A Brain-Inspired Geometric Memory for Class-Incremental LearningZheng Zhang, Jiaye Yang, Qingjie Guo, Jiangrong Shen et al.ICML 2026
Builds on4
- Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural NetworksQi Xu, Yuyuan Gao, Jiangrong Shen, Yaxin Li et al.NeurIPS 2023 · 30 citations
- EICIL: Joint Excitatory Inhibitory Cycle Iteration Learning for Deep Spiking Neural NetworksZihang Shao, Xuanye Fang, Yaxin Li, Chaoran Feng et al.NeurIPS 2023 · 15 citations
- Why do networks have inhibitory/negative connections?Qingyang Wang, Michael A. Powell, Ali Geisa, Eric Bridgeford et al.ICCV 2023 · 10 citations
- RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural NetworkBing Han, Gopalakrishnan Srinivasan, Kaushik RoyCVPR 2020
Related papers
- ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural NetworksJiangrong Shen, Qi Xu, Jian K. Liu, Yueming Wang et al.AAAI 2023 · 64 citations
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier et al.ICCV 2021 · 731 citations
- A Progressive Training Framework for Spiking Neural Networks with Learnable Multi-hierarchical ModelZecheng Hao, Xinyu Shi, Zihan Huang, Tong Bu et al.ICLR 2024 · 16 citations
- Reversing Structural Pattern Learning with Biologically Inspired Knowledge Distillation for Spiking Neural NetworksQi Xu, Yaxin Li, Xuanye Fang, Jiangrong Shen et al.ACM MM 2024 · 12 citations
- Brain-inspired Multilayer Perceptron with Spiking NeuronsWenshuo Li, Hanting Chen, Jianyuan Guo, Ziyang Zhang et al.CVPR 2022 · 37 citations
