Discovering heterogeneous synaptic plasticity rules via large-scale neural evolution
Ziyuan Ye, Beichen Huang, Yujie Wu, Guozhang Chen, Jibin Wu
Abstract
Synaptic plasticity is a fundamental substrate for learning and memory, where different synapse types exhibit distinct plasticity mechanisms. However, how functional behaviors emerge from heterogeneous synaptic plasticity mechanisms remains poorly understood. Here, we introduce a computational framework that harnesses Darwinian evolutionary principles to discover biologically plausible, heterogeneous synaptic plasticity rules within a biologically realistic model of the mouse primary visual cortex. Specifically, we parameterize several key factors related to synaptic plasticity, including presynaptic and postsynaptic spikes, their associated eligibility traces, and neuromodulatory signals. By integrating these factors via a truncated Taylor expansion, we construct a large-scale search space of candidate plasticity rules, with each rule containing over 2.6k optimizable parameters. Each rule is subsequently evaluated on both cross-domain visual task performance and biological validity. Leveraging a multi-objective evolutionary algorithm, we effectively navigate this high-dimensional search space to identify plasticity rules that are both biologically plausible and yield high task performance. We uncover diverse families of high-performing plasticity rules that achieve similar behavioral outcomes despite markedly different mathematical formulations, suggesting that real-world synaptic learning mechanisms may exhibit computational degeneracy. We further show that these biologically plausible rules are not only robust across network scales but also enable few-shot learning, offering a computational explanation for the emergence of innate ability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e63d5ca7-32e4-4cb3-8f69-4504aa54b4c0Builds on10
- Meta-Learning through Hebbian Plasticity in Random NetworksElias Najarro, Sebastian RisiNeurIPS 2020 · 99 citations
- Local plasticity rules can learn deep representations using self-supervised contrastive predictionsBernd Illing, Jean Ventura, Guillaume Bellec, Wulfram GerstnerNeurIPS 2021 · 99 citations
- A meta-learning approach to (re)discover plasticity rules that carve a desired function into a neural networkBasile Confavreux, Friedemann Zenke, Everton J. Agnes, Timothy P. Lillicrap et al.NeurIPS 2020 · 40 citations
- Inferring learning rules from animal decision-makingZoe Ashwood, Nicholas A. Roy, Ji Hyun Bak, Jonathan W. PillowNeurIPS 2020 · 33 citations
- Meta-learning families of plasticity rules in recurrent spiking networks using simulation-based inferenceBasile Confavreux, Poornima Ramesh, Pedro J. Gonçalves, Jakob H. Macke et al.NeurIPS 2023 · 18 citations
Related papers
- Hebbian and Gradient-based Plasticity Enables Robust Memory and Rapid Learning in RNNsYu Duan, Zhongfan Jia, Qian Li, Yi Zhong et al.ICLR 2023 · 1 citation
- Memory by accident: a theory of learning as a byproduct of network stabilizationBasile Confavreux, William Dorrell, Nishil Patel, Andrew M. SaxeNeurIPS 2025 · 2 citations
- Model Based Inference of Synaptic Plasticity RulesYash Mehta, Danil Tyulmankov, Adithya Rajagopalan, Glenn Turner et al.NeurIPS 2024 · 9 citations
- Formalizing locality for normative synaptic plasticity modelsColin Bredenberg, Ezekiel Williams, Cristina Savin, Blake A. Richards et al.NeurIPS 2023 · 14 citations
- Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learningThomas MiconiICML 2023 · 7 citations
