FAT-TAG: Mitigating Forgetting in Task-Free Temporal Graph Class Incremental Learning
Jiyuan Feng, Zhao Liu, Dongyi Zheng, Weihong Han, Binxing Fang, Qing Liao
Abstract
The class Incremental Learning aims to train on task sequences continuously, each task introducing a distinct set of classes. Class Incremental Learning on graphs follows the same paradigm but introduces two additional challenges. First, most existing studies overlook the temporal dimension of real-world graphs. These studies approximate the evolving network by slicing a static graph into ordered tasks and assigning newly added nodes to discrete tasks, yet they fail to model explicit temporal dependencies between nodes. Second, many methods still depend on predefined task boundaries and task identifiers when performing inference. This situation severely restricts their use in genuinely task-free scenarios. In this paper, we introduce FAT-TAG, a task-free Temporal Graph Class Incremental Learning framework. (1) FAT-TAG performs temporal graph tokenization to retain structural dependencies while encoding temporal precedence for Graph Transformer. (2) FAT-TAG adopts a Freeze-and-Adapt Training paradigm that trains the Graph Transformer backbone model only on the initial task and equips every subsequent task with a lightweight Low-Rank adapter, effectively preventing catastrophic forgetting. (3) FAT-TAG incorporates a Time-Aware Gate that routes instance-level samples to the most appropriate LoRA adapter without relying on task identifiers, thus achieving task-free inference. Extensive experiments across four real-world temporal graph benchmarks show that FAT-TAG consistently surpasses state-of-the-art baselines in mitigating forgetting. The source code is available at https://github.com/fengjiyuan/TAG.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- G2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed GraphsYuhan Wang, Yibo Ding, Yutong Ye, Mufan Zhao et al.KDD 2026 · 1 citation
- Class-Domain Incremental Learning on Graphs via Disentangled Knowledge DistillationQin Tian, Chen Zhao, Xintao Wu, Dong Li et al.WWW 2026
- Replay-and-Forget-Free Graph Class-Incremental Learning: A Task Profiling and Prompting ApproachChaoxi Niu, Guansong Pang, Ling Chen, Bing LiuNeurIPS 2024 · 32 citations
- Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba, Aditya Rawal et al.NeurIPS 2022 · 75 citations
- Few-Shot Incremental Learning With Continually Evolved ClassifiersChi Zhang, Nan Song, Guosheng Lin, Yun Zheng et al.CVPR 2021
