HLML-SNN:Fast Continual Learning in Spiking Neural Networks Achieved via Hebbian Learning-Driven Meta-Learning
Jiangshuai Xu, Peiyun Xue, Jiacheng Song, Xuhui Huang, Qingshan Hou
摘要
Catastrophic forgetting remains a fundamental barrier to artificial continual learning (CL) -a capability innate to humans. Existing CL methods often incur prohibitive computational costs in resource-constrained scenarios. Spiking neural networks (SNNs), with their biological plausibility and energy efficiency, offer distinct advantages for CL. Inspired by cortico-hippocampal memory mechanisms, we propose a spiking neural network framework integrating Hebbian plasticity with meta-learning, named HLML-SNN. This architecture emulates a dual-phase task-incremental CL process: (1) In the short-term phase, sample-level Hebbian learning rapidly adapts to new inputs through local synaptic updates; (2) In the long-term phase, task-level meta-learning optimizes cross-task parameters using consolidated synaptic weights, mimicking cortical memory integration to refine shared representations and initialize subsequent Hebbian learning. HLML-SNN incrementally transforms shortterm adaptations into stable long-term knowledge, where the synergy of rapid synaptic updates and meta-driven global optimization enables efficient continual learning while balancing stability and plasticity. Empirical results establish HLML-SNN's state-of-the-art performance across split-MNIST/CIFAR10/CIFAR100/TinyImageNet while markedly reducing training time compared to existing methods, demonstrating substantial practical potential for rapid deployment scenarios. The code and appendix are available on https://github.com/JiangshuaiXu/HLML SNN.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionArthur Douillard, Alexandre Ramé, Guillaume Couairon, Matthieu CordCVPR 2022 · 被引用 315 次
- MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental LearningZhixiang Chi, Li Gu, Huan Liu, Yang Wang 等CVPR 2022 · 被引用 149 次
- Continuously Learning, Adapting, and Improving: A Dual-Process Approach to Autonomous DrivingJianbiao Mei, Yukai Ma, Xuemeng Yang, Licheng Wen 等NeurIPS 2024 · 被引用 53 次
- Optimizing Reusable Knowledge for Continual Learning via MetalearningJulio Hurtado, Alain Raymond-Saez, Alvaro SotoNeurIPS 2021 · 被引用 47 次
- Meta Continual Learning Revisited: Implicitly Enhancing Online Hessian Approximation via Variance ReductionYichen Wu, Long-Kai Huang, Renzhen Wang, Deyu Meng 等ICLR 2024 · 被引用 42 次
相关 Paper
- Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural NetworksMingqing Xiao, Qingyan Meng, Zongpeng Zhang, Di He 等ICLR 2024 · 被引用 17 次
- Efficient Spiking Neural Networks with Sparse Selective Activation for Continual LearningJiangrong Shen, Wenyao Ni, Qi Xu, Huajin TangAAAI 2024 · 被引用 42 次
- Multi-Synaptic Cooperation: A Bio-Inspired Framework for Robust and Scalable Continual LearningPenghui Li, Zhuang Ma, Yunliang Zang, Qiang YuICLR 2026
- Learning to Continually Learn with the Bayesian PrincipleSoochan Lee, Hyeonseong Jeon, Jaehyeon Son, Gunhee KimICML 2024 · 被引用 11 次
- Replay4NCL: An Efficient Memory Replay-based Methodology for Neuromorphic Continual Learning in Embedded AI SystemsMishal Fatima Minhas, Rachmad Vidya Wicaksana Putra, Falah Awwad, Osman Hasan 等DAC 2025 · 被引用 2 次
