Beyond Linear Processing: Dendritic Bilinear Integration in Spiking Neural Networks
Jingyang Ma, Chongming Liu, Songting Li, Douglas Zhou
Abstract
As widely used neuron model in Spiking Neural Networks (SNNs), the Leaky Integrate-and-Fire (LIF) model assumes the linear summation of injected currents. However, recent studies have revealed that a biological neuron can integrate inputs nonlinearly and perform computations such as XOR while an LIF neuron cannot. To bridge this gap, we propose the Dendritic LIF (DLIF) model, which incorporates a bilinear dendritic integration rule derived from neurophysiological experiments. At the single-neuron level, we theoretically demonstrate that a DLIF neuron can capture input correlations, enabling it to perform nonlinear classification tasks. At the network level, we prove that DLIF neurons can preserve and propagate correlation structures from the input layer to the readout layer. These theoretical findings are further confirmed by our numerical experiments. Extensive experiments across diverse architectures-including ResNet, VGG, and Transformer-demonstrate that DLIF achieves state-of-the-art performance on static (CIFAR-10/100, ImageNet) and neuromorphic (DVS-Gesture, DVS-CIFAR10) benchmarks, surpassing LIF and other advanced alternatives while maintaining comparable computational cost. This work provides a biologically plausible and computationally powerful spiking neuron model, paving the way for next-generation brain-inspired computing. All source code are available at https://github.com/majingyang0119/DLIF .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ed76f46-11ea-4aa1-bedf-596133446b66Builds on19
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier et al.ICCV 2021 · 731 citations
- Going Deeper With Directly-Trained Larger Spiking Neural NetworksHanle Zheng, Yujie Wu, Lei Deng, Yifan Hu et al.AAAI 2021 · 694 citations
- Spike-driven TransformerMan Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan et al.NeurIPS 2023 · 368 citations
- Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingShikuang Deng, Yuhang Li, Shanghang Zhang, Shi GuICLR 2022 · 361 citations
Related papers
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural NetworksXingting Yao, Fanrong Li, Zitao Mo, Jian ChengNeurIPS 2022 · 175 citations
- Dendritic Integration Inspired Artificial Neural Networks Capture Data CorrelationChongming Liu, Jingyang Ma, Songting Li, Douglas ZhouNeurIPS 2024 · 11 citations
- Incorporating the Refractory Period into Spiking Neural Networks through Spike-Triggered Threshold DynamicsYang Li, Xinyi Zeng, Zhe Xue, Pinxian Zeng et al.ACM MM 2025 · 2 citations
- TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential ModellingShimin Zhang, Qu Yang, Chenxiang Ma, Jibin Wu et al.AAAI 2024 · 51 citations
- Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech RecognitionQingyu Wang, Tielin Zhang, Minglun Han, Yi Wang et al.AAAI 2023 · 40 citations
