GraphKeeper: Graph Domain-Incremental Learning via Knowledge Disentanglement and Preservation
Zihao Guo, Qingyun Sun, Ziwei Zhang, Haonan Yuan, Huiping Zhuang, Xingcheng Fu, Jianxin Li
Abstract
Graph incremental learning (GIL), which continuously updates graph models by sequential knowledge acquisition, has garnered significant interest recently. However, existing GIL approaches focus on task-incremental and class-incremental scenarios within a single domain. Graph domain-incremental learning (Domain-IL), aiming at updating models across multiple graph domains, has become critical with the development of graph foundation models (GFMs), but remains unexplored in the literature. In this paper, we propose Graph Domain-Incremental Learning via Knowledge Dientanglement and Preservation (GraphKeeper), to address catastrophic forgetting in Domain-IL scenario from the perspectives of embedding shifts and decision boundary deviations. Specifically, to prevent embedding shifts and confusion across incremental graph domains, we first propose the domain-specific parameter-efficient fine-tuning together with intra- and inter-domain disentanglement objectives. Consequently, to maintain a stable decision boundary, we introduce deviation-free knowledge preservation to continuously fit incremental domains. Additionally, for graphs with unobservable domains, we perform domain-aware distribution discrimination to obtain precise embeddings. Extensive experiments demonstrate the proposed GraphKeeper achieves state-of-the-art results with 6.5% 16.6% improvement over the runner-up with negligible forgetting. Moreover, we show GraphKeeper can be seamlessly integrated with various representative GFMs, highlighting its broad applicative potential.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 84a68835-a76f-427c-b347-c0d8ee8d63ffCited by top-tier papers2
- Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector BundlesLi Sun, Zhenhao Huang, Yiding Wang, Qin Chen et al.ICML 2026
- RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented GenerationHaonan Yuan, Qingyun Sun, Jiacheng Tao, Xingcheng Fu et al.WWW 2026
Builds on21
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph EmbeddingXinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin KingWWW 2020 · 1,149 citations
- RanPAC: Random Projections and Pre-trained Models for Continual LearningMark D. McDonnell, Dong Gong, Amin Parvaneh, Ehsan Abbasnejad et al.NeurIPS 2023 · 245 citations
- Overcoming Catastrophic Forgetting in Graph Neural Networks with Experience ReplayFan Zhou, Chengtai CaoAAAI 2021 · 175 citations
- Overcoming Catastrophic Forgetting in Graph Neural NetworksHuihui Liu, Yiding Yang, Xinchao WangAAAI 2021 · 166 citations
Related papers
- Class-Domain Incremental Learning on Graphs via Disentangled Knowledge DistillationQin Tian, Chen Zhao, Xintao Wu, Dong Li et al.WWW 2026
- Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li et al.EMNLP 2020 · 26 citations
- Collaborative Knowledge Extraction and Integration for Graph Domain Incremental LearningJialu Li, Yu Wang, Wanyu Lin, Pengfei ZhuKDD 2026
- GCAL: Adapting Graph Models to Evolving Domain ShiftsZiyue Qiao, Qianyi Cai, Hao Dong, Jiawei Gu et al.ICML 2025
- Towards Effective Federated Graph Foundation Model via Mitigating Knowledge EntanglementYinlin Zhu, Xunkai Li, Jishuo Jia, Miao Hu et al.NeurIPS 2025 · 17 citations
