Online Learning Of Neural Computations From Sparse Temporal Feedback
Mikio Ludwig Braun, Tim P. Vogels
Abstract
Neuronal computations depend on synaptic connectivity and intrinsic electrophysiological properties. Synaptic connectivity determines which inputs from presynaptic neurons are integrated, while cellular properties determine how inputs are filtered over time. Unlike their biological counterparts, most computational approaches to learning in simulated neural networks are limited to changes in synaptic connectivity. However, if intrinsic parameters change, neural computations are altered drastically. Here, we include the parameters that determine the intrinsic properties, e.g., time constants and reset potential, into the learning paradigm. Using sparse feedback signals that indicate target spike times, and gradient-based parameter updates, we show that the intrinsic parameters can be learned along with the synaptic weights to produce specific input-output functions. Specifically, we use a teacher-student paradigm in which a randomly initialised leaky integrate-and-fire or resonate-and-fire neuron must recover the parameters of a teacher neuron. We show that complex temporal functions can be learned online and without backpropagation through time, relying on event-based updates only. Our results are a step towards online learning of neural computations from ungraded and unsigned sparse feedback signals with a biologically inspired learning mechanism.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Addressing the speed-accuracy simulation trade-off for adaptive spiking neuronsLuke Taylor, Andrew J. King, Nicol S. HarperNeurIPS 2023 · 11 citations
- Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rulesYuhan Helena Liu, Arna Ghosh, Blake A. Richards, Eric Shea-Brown et al.NeurIPS 2022 · 10 citations
Builds on1
Related papers
- SparseProp: Efficient Event-Based Simulation and Training of Sparse Recurrent Spiking Neural NetworksRainer EngelkenNeurIPS 2023 · 15 citations
- Reconstructing Spiking Neural Networks Using a Single Neuron with AutapsesWuque Cai, Hongze Sun, Quan Tang, Shifeng Mao et al.CVPR 2026
- HetSyn: Versatile Timescale Integration in Spiking Neural Networks via Heterogeneous SynapsesZhichao Deng, Zhikun Liu, Junxue Wang, Shengqian Chen et al.NeurIPS 2025 · 2 citations
- Deep Spiking Neural Network with Neural Oscillation and Spike-Phase InformationYi Chen, Hong Qu, Malu Zhang, Yuchen WangAAAI 2021 · 19 citations
- Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium StateMingqing Xiao, Qingyan Meng, Zongpeng Zhang, Yisen Wang et al.NeurIPS 2021 · 83 citations
