Neuronal Competition Groups with Supervised STDP for Spike-Based Classification
Gaspard Goupy, Pierre Tirilly, Ioan Marius Bilasco
Abstract
Spike Timing-Dependent Plasticity (STDP) is a promising substitute to backpropagation for local training of Spiking Neural Networks (SNNs) on neuromorphic hardware. STDP allows SNNs to address classification tasks by combining unsupervised STDP for feature extraction and supervised STDP for classification. Unsupervised STDP is usually employed with Winner-Takes-All (WTA) competition to learn distinct patterns. However, WTA for supervised STDP classification faces unbalanced competition challenges. In this paper, we propose a method to effectively implement WTA competition in a spiking classification layer employing first-spike coding and supervised STDP training. We introduce the Neuronal Competition Group (NCG), an architecture that improves classification capabilities by promoting the learning of various patterns per class. An NCG is a group of neurons mapped to a specific class, implementing intra-class WTA and a novel competition regulation mechanism based on two-compartment thresholds. We incorporate our proposed architecture into spiking classification layers trained with state-of-the-art supervised STDP rules. On top of two different unsupervised feature extractors, we obtain significant accuracy improvements on image recognition datasets such as CIFAR-10 and CIFAR-100. We show that our competition regulation mechanism is crucial for ensuring balanced competition and improved class separation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2d40060c-a10a-4811-9d6d-56461c4a76dbBuilds on5
- Spike-driven TransformerMan Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan et al.NeurIPS 2023 · 368 citations
- Temporal Effective Batch Normalization in Spiking Neural NetworksChaoteng Duan, Jianhao Ding, Shiyan Chen, Zhaofei Yu et al.NeurIPS 2022 · 141 citations
- T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike CodingSeongsik Park, Sei Joon Kim, Byunggook Na, Sungroh YoonDAC 2020 · 121 citations
- SEENN: Towards Temporal Spiking Early Exit Neural NetworksYuhang Li, Tamar Geller, Youngeun Kim, Priyadarshini PandaNeurIPS 2023 · 82 citations
- In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic ProcessorAmar Shrestha, Haowen Fang, Daniel Patrick Rider, Zaidao Mei et al.DAC 2021 · 33 citations
Related papers
- Emergence of Hierarchical Layers in a Single Sheet of Self-Organizing Spiking NeuronsPaul Bertens, Seong-Whan LeeNeurIPS 2022 · 3 citations
- Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent BackpropagationNitin Rathi, Gopalakrishnan Srinivasan, Priyadarshini Panda, Kaushik RoyICLR 2020 · 347 citations
- Exploring Loss Functions for Time-based Training Strategy in Spiking Neural NetworksYaoyu Zhu, Wei Fang, Xiaodong Xie, Tiejun Huang et al.NeurIPS 2023 · 26 citations
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu et al.AAAI 2021 · 694 citations
- Sequence Approximation using Feedforward Spiking Neural Network for Spatiotemporal Learning: Theory and Optimization MethodsXueyuan She, Saurabh Dash, Saibal MukhopadhyayICLR 2022 · 39 citations
