Parameter-Masked Decoupled Optimization for Cross-Domain Class-Incremental Learning
Ziqi Gu, Chunyan Xu, Yangguang Liu, Wenxuan Fang, Baotong Su, Tong Zhang, Dan Wang, Zhen Cui
摘要
Cross-domain class-incremental learning (CD-CIL) requires models to continuously acquire new classes across shifting domains while retaining previously learned knowledge. Existing approaches often entangle what to update with how to update, resulting in unstable adaptation and severe forgetting under domain shifts. Inspired by the hippocampal learning mechanism that separates rapid adaptation from stable consolidation, we propose Parameter-Masked Decoupled Optimization (PMDO) that disentangles what knowledge is adapted from how learning proceeds in cross-domain class-incremental learning. We introduce a domain-aware knowledge decoupler that selectively adapts domain-relevant shared parameters, constraining incremental updates while preserving prior representations. To regulate how learning proceeds, we further design a stability-aware trajectory regulation that guides optimization along transferable and stable optimization trajectories, thereby reducing interference across domain transitions. PMDO enables effective cross-domain adaptation while mitigating catastrophic forgetting and maintaining long-term learnability. Extensive experiments across multiple benchmarks demonstrate the effectiveness of PMDO and its superiority over state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper26
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 被引用 7,873 次
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath 等ICCV 2021 · 被引用 2,294 次
- Constrained Few-shot Class-incremental LearningMichael Hersche, Geethan Karunaratne, Giovanni Cherubini, Luca Benini 等CVPR 2022 · 被引用 152 次
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language ModelsZangwei Zheng, Mingyuan Ma, Kai Wang, Ziheng Qin 等ICCV 2023 · 被引用 133 次
相关 Paper
- Make Domain Shift a Catastrophic Forgetting Alleviator in Class-Incremental LearningWei Chen, Yi ZhouAAAI 2025 · 被引用 4 次
- Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental LearningLinjie Li, HUIYU XIAO, Jiarui Cao, Zhenyu Wu 等CVPR 2026 · 被引用 1 次
- CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual LearningYu Feng, Zhen Tian, Yifan Zhu, Zongfu Han 等ACM MM 2024 · 被引用 15 次
- GraphKeeper: Graph Domain-Incremental Learning via Knowledge Disentanglement and PreservationZihao Guo, Qingyun Sun, Ziwei Zhang, Haonan Yuan 等NeurIPS 2025 · 被引用 10 次
- Class-Domain Incremental Learning on Graphs via Disentangled Knowledge DistillationQin Tian, Chen Zhao, Xintao Wu, Dong Li 等WWW 2026
