Lune

EMNLP Findings2023

Temporal Extrapolation and Knowledge Transfer for Lifelong Temporal Knowledge Graph Reasoning

Zhongwu Chen, Chengjin Xu, Fenglong Su, Zhen Huang, Yong Dou

Abstract

Real-world Temporal Knowledge Graphs keep growing with time and new entities and facts emerge continually, necessitating a model that can extrapolate to future timestamps and transfer knowledge for new components. Therefore, our work first dives into this more realistic issue, lifelong TKG reasoning, where existing methods can only address part of the challenges. Specifically, we formulate lifelong TKG reasoning as a temporal-path-based reinforcement learning (RL) framework. Then, we add temporal displacement into the action space of RL to extrapolate for the future and further propose a temporal-rule-based reward shaping to guide the training. To transfer and update knowledge, we design a new edge-aware message passing module, where the embeddings of new entities and edges are inductive. We conduct extensive experiments on three newly constructed benchmarks for lifelong TKG reasoning. Experimental results show the outperforming effectiveness of our model against all well-adapted baselines.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning cites Recurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge Graphs
  • Recurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge Graphs cites Tensor Decompositions for Temporal Knowledge Base Completion
  • DPCL-Diff:Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive Learning cites Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning
  • DPCL-Diff:Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive Learning cites Recurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge Graphs
  • DPCL-Diff:Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive Learning cites Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. DPCL-Diff:Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive LearningYukun Cao, Lisheng Wang, Luobin HuangAAAI 2025 · 5 citations
  2. A New Pipeline for Knowledge Graph Reasoning Enhanced by Large Language Models Without Fine-TuningZhongwu Chen, Long Bai, Zixuan Li, Zhen Huang et al.EMNLP 2024 · 3 citations

Builds on14

  1. Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
  2. Recurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge GraphsWoojeong Jin, Meng Qu, Xisen Jin, Xiang RenEMNLP 2020 · 353 citations
  3. Temporal Knowledge Graph Reasoning Based on Evolutional Representation LearningZixuan Li, Xiaolong Jin, Wei Li, Saiping Guan et al.SIGIR 2021 · 345 citations
  4. Tensor Decompositions for Temporal Knowledge Base CompletionTimothée Lacroix, Guillaume Obozinski, Nicolas UsunierICLR 2020 · 341 citations
  5. Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge GraphsZhen Han, Peng Chen, Yunpu Ma, Volker TrespICLR 2021 · 213 citations

Related papers

  1. Lifelong Embedding Learning and Transfer for Growing Knowledge GraphsYuanning Cui, Yuxin Wang, Zequn Sun, Wenqiang Liu et al.AAAI 2023 · 57 citations
  2. TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph ForecastingHaohai Sun, Jialun Zhong, Yunpu Ma, Zhen Han et al.EMNLP 2021 · 164 citations
  3. Meta-Learning Based Knowledge Extrapolation for Temporal Knowledge GraphZhongwu Chen, Chengjin Xu, Fenglong Su, Zhen Huang et al.WWW 2023 · 18 citations
  4. MetaTKG: Learning Evolutionary Meta-Knowledge for Temporal Knowledge Graph ReasoningYuwei Xia, Mengqi Zhang, Qiang Liu, Shu Wu et al.EMNLP 2022 · 11 citations
  5. DREAM: Adaptive Reinforcement Learning based on Attention Mechanism for Temporal Knowledge Graph ReasoningShangfei Zheng, Hongzhi Yin, Tong Chen, Quoc Viet Hung Nguyen et al.SIGIR 2023 · 27 citations
Dusk over the sea between two cliffs drawn in fine vertical lines