Multi-Faceted Continual Knowledge Graph Embedding for Semantic-Aware Link Prediction
Jing Qi, Yuxiang Wang, Zhiyuan Yu, Xiaoliang Xu, Yuanshi Zheng, Tianxing Wu
Abstract
Continual Knowledge Graph Embedding (CKGE) aims to continually learn embeddings for new knowledge, i.e., entities and relations, while retaining previously acquired knowledge. Most existing CKGE methods mitigate catastrophic forgetting via regularization or replaying old knowledge. They conflate new and old knowledge of an entity within the same embedding space to seek a balance between them. However, entities inherently exhibit multi-faceted semantics that evolve dynamically as their relational contexts change over time. A shared embedding fails to capture and distinguish these temporal semantic variations, degrading lifelong link prediction accuracy across snapshots. To address this, we propose a Multi-Faceted CKGE framework (MF-CKGE) for semantic-aware link prediction. During offline learning, MF-CKGE separates temporal old and new knowledge into distinct embedding spaces to prevent knowledge entanglement and employs semantic decoupling to reduce semantic redundancy, thereby improving space efficiency. During online inference, MF-CKGE adaptively identifies semantically query-relevant entity embeddings by quantifying their semantic importance, reducing interference from query-irrelevant noise. Experiments on eight datasets show that MF-CKGE achieves an average (maximum) improvement of 1.7% (2.7%) and 1.4% (3.8%) in MRR and Hits@10, respectively, over the best baseline. Our source code and datasets are available at: https://anonymous.4open.science/r/MF-CKGE-04E5.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5716f2fa-618d-433c-b9d0-a6d3e503e39cBuilds on10
- HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language ModelsBernal Jimenez Gutierrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga et al.NeurIPS 2024 · 395 citations
- Lifelong Embedding Learning and Transfer for Growing Knowledge GraphsYuanning Cui, Yuxin Wang, Zequn Sun, Wenqiang Liu et al.AAAI 2023 · 57 citations
- Towards Continual Knowledge Graph Embedding via Incremental DistillationJiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang et al.AAAI 2024 · 52 citations
- Semantic Guided and Response Times Bounded Top-k Similarity Search over Knowledge GraphsYuxiang Wang, Arijit Khan, Tianxing Wu, Jiahui Jin et al.ICDE 2020 · 45 citations
- A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge GraphsXingyue Huang, Miguel Romero, Ismail Ilkan Ceylan, Pablo BarcelóNeurIPS 2023 · 38 citations
Related papers
- SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph EmbeddingYifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao et al.KDD 2025 · 2 citations
- Towards Multimodal Continual Knowledge Embedding wth Modality Forgetting ModulationXiaowen Jiang, Jing Yang, Shundong Yang, Yuan Gao et al.AAAI 2026
- Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li et al.EMNLP 2020 · 26 citations
- From Knowledge Forgetting to Accumulation: Evolutionary Relation Path Passing for Lifelong Knowledge Graph EmbeddingJing Yang, Xinfa Jiang, Xiaowen Jiang, Yuan Gao et al.SIGIR 2025 · 2 citations
- STARK: Structure-Aware and Adaptive Representation Learning for Continual Knowledge Graph EmbeddingKyung-Hwan Lee, Dong-Wan ChoiWWW 2026
