Parameter-Masked Decoupled Optimization for Cross-Domain Class-Incremental Learning
Ziqi Gu, Chunyan Xu, Yangguang Liu, Wenxuan Fang, Baotong Su, Tong Zhang, Dan Wang, Zhen Cui
Abstract
Cross-domain class-incremental learning (CD-CIL) requires models to continuously acquire new classes across shifting domains while retaining previously learned knowledge. Existing approaches often entangle what to update with how to update, resulting in unstable adaptation and severe forgetting under domain shifts. Inspired by the hippocampal learning mechanism that separates rapid adaptation from stable consolidation, we propose Parameter-Masked Decoupled Optimization (PMDO) that disentangles what knowledge is adapted from how learning proceeds in cross-domain class-incremental learning. We introduce a domain-aware knowledge decoupler that selectively adapts domain-relevant shared parameters, constraining incremental updates while preserving prior representations. To regulate how learning proceeds, we further design a stability-aware trajectory regulation that guides optimization along transferable and stable optimization trajectories, thereby reducing interference across domain transitions. PMDO enables effective cross-domain adaptation while mitigating catastrophic forgetting and maintaining long-term learnability. Extensive experiments across multiple benchmarks demonstrate the effectiveness of PMDO and its superiority over state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9edbf63e-ebf2-4951-be15-3c5ce34ba6d9Builds on26
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- Constrained Few-shot Class-incremental LearningMichael Hersche, Geethan Karunaratne, Giovanni Cherubini, Luca Benini et al.CVPR 2022 · 152 citations
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language ModelsZangwei Zheng, Mingyuan Ma, Kai Wang, Ziheng Qin et al.ICCV 2023 · 133 citations
Related papers
- Make Domain Shift a Catastrophic Forgetting Alleviator in Class-Incremental LearningWei Chen, Yi ZhouAAAI 2025 · 4 citations
- Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental LearningLinjie Li, HUIYU XIAO, Jiarui Cao, Zhenyu Wu et al.CVPR 2026 · 1 citation
- CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual LearningYu Feng, Zhen Tian, Yifan Zhu, Zongfu Han et al.ACM MM 2024 · 15 citations
- GraphKeeper: Graph Domain-Incremental Learning via Knowledge Disentanglement and PreservationZihao Guo, Qingyun Sun, Ziwei Zhang, Haonan Yuan et al.NeurIPS 2025 · 10 citations
- Class-Domain Incremental Learning on Graphs via Disentangled Knowledge DistillationQin Tian, Chen Zhao, Xintao Wu, Dong Li et al.WWW 2026
