Beyond Linear Processing: Dendritic Bilinear Integration in Spiking Neural Networks
Jingyang Ma, Chongming Liu, Songting Li, Douglas Zhou
摘要
As widely used neuron model in Spiking Neural Networks (SNNs), the Leaky Integrate-and-Fire (LIF) model assumes the linear summation of injected currents. However, recent studies have revealed that a biological neuron can integrate inputs nonlinearly and perform computations such as XOR while an LIF neuron cannot. To bridge this gap, we propose the Dendritic LIF (DLIF) model, which incorporates a bilinear dendritic integration rule derived from neurophysiological experiments. At the single-neuron level, we theoretically demonstrate that a DLIF neuron can capture input correlations, enabling it to perform nonlinear classification tasks. At the network level, we prove that DLIF neurons can preserve and propagate correlation structures from the input layer to the readout layer. These theoretical findings are further confirmed by our numerical experiments. Extensive experiments across diverse architectures-including ResNet, VGG, and Transformer-demonstrate that DLIF achieves state-of-the-art performance on static (CIFAR-10/100, ImageNet) and neuromorphic (DVS-Gesture, DVS-CIFAR10) benchmarks, surpassing LIF and other advanced alternatives while maintaining comparable computational cost. This work provides a biologically plausible and computationally powerful spiking neuron model, paving the way for next-generation brain-inspired computing. All source code are available at https://github.com/majingyang0119/DLIF .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh 等ICCV 2019 · 被引用 5,843 次
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier 等ICCV 2021 · 被引用 731 次
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu 等AAAI 2021 · 被引用 694 次
- Spike-driven TransformerMan Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan 等NeurIPS 2023 · 被引用 368 次
- Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingShikuang Deng, Yuhang Li, Shanghang Zhang, Shi GuICLR 2022 · 被引用 361 次
相关 Paper
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural NetworksXingting Yao, Fanrong Li, Zitao Mo, Jian ChengNeurIPS 2022 · 被引用 175 次
- Dendritic Integration Inspired Artificial Neural Networks Capture Data CorrelationChongming Liu, Jingyang Ma, Songting Li, Douglas ZhouNeurIPS 2024 · 被引用 11 次
- Incorporating the Refractory Period into Spiking Neural Networks through Spike-Triggered Threshold DynamicsYang Li, Xinyi Zeng, Zhe Xue, Pinxian Zeng 等ACM MM 2025 · 被引用 2 次
- TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential ModellingShimin Zhang, Qu Yang, Chenxiang Ma, Jibin Wu 等AAAI 2024 · 被引用 51 次
- Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech RecognitionQingyu Wang, Tielin Zhang, Minglun Han, Yi Wang 等AAAI 2023 · 被引用 40 次
