Neuronal Competition Groups with Supervised STDP for Spike-Based Classification
Gaspard Goupy, Pierre Tirilly, Ioan Marius Bilasco
摘要
Spike Timing-Dependent Plasticity (STDP) is a promising substitute to backpropagation for local training of Spiking Neural Networks (SNNs) on neuromorphic hardware. STDP allows SNNs to address classification tasks by combining unsupervised STDP for feature extraction and supervised STDP for classification. Unsupervised STDP is usually employed with Winner-Takes-All (WTA) competition to learn distinct patterns. However, WTA for supervised STDP classification faces unbalanced competition challenges. In this paper, we propose a method to effectively implement WTA competition in a spiking classification layer employing first-spike coding and supervised STDP training. We introduce the Neuronal Competition Group (NCG), an architecture that improves classification capabilities by promoting the learning of various patterns per class. An NCG is a group of neurons mapped to a specific class, implementing intra-class WTA and a novel competition regulation mechanism based on two-compartment thresholds. We incorporate our proposed architecture into spiking classification layers trained with state-of-the-art supervised STDP rules. On top of two different unsupervised feature extractors, we obtain significant accuracy improvements on image recognition datasets such as CIFAR-10 and CIFAR-100. We show that our competition regulation mechanism is crucial for ensuring balanced competition and improved class separation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Spike-driven TransformerMan Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan 等NeurIPS 2023 · 被引用 368 次
- Temporal Effective Batch Normalization in Spiking Neural NetworksChaoteng Duan, Jianhao Ding, Shiyan Chen, Zhaofei Yu 等NeurIPS 2022 · 被引用 141 次
- T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike CodingSeongsik Park, Sei Joon Kim, Byunggook Na, Sungroh YoonDAC 2020 · 被引用 121 次
- SEENN: Towards Temporal Spiking Early Exit Neural NetworksYuhang Li, Tamar Geller, Youngeun Kim, Priyadarshini PandaNeurIPS 2023 · 被引用 82 次
- In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic ProcessorAmar Shrestha, Haowen Fang, Daniel Patrick Rider, Zaidao Mei 等DAC 2021 · 被引用 33 次
相关 Paper
- Emergence of Hierarchical Layers in a Single Sheet of Self-Organizing Spiking NeuronsPaul Bertens, Seong-Whan LeeNeurIPS 2022 · 被引用 3 次
- Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent BackpropagationNitin Rathi, Gopalakrishnan Srinivasan, Priyadarshini Panda, Kaushik RoyICLR 2020 · 被引用 347 次
- Exploring Loss Functions for Time-based Training Strategy in Spiking Neural NetworksYaoyu Zhu, Wei Fang, Xiaodong Xie, Tiejun Huang 等NeurIPS 2023 · 被引用 26 次
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu 等AAAI 2021 · 被引用 694 次
- Sequence Approximation using Feedforward Spiking Neural Network for Spatiotemporal Learning: Theory and Optimization MethodsXueyuan She, Saurabh Dash, Saibal MukhopadhyayICLR 2022 · 被引用 39 次
