SAOT: Self-Supervised Continual Graph Learning with Structure-Aware Optimal Transport
Yuting Zhang, Zhitao Xiao, Zhitao Xiao, Lei Geng, Yanwei Pang, Xiao Wang
Abstract
Self-supervised Continual Graph Learning (CGL) aims to successively learn from a graph sequence with different tasks without label supervision—a paradigm that has attracted widespread attention. Most existing self-supervised CGL methods rely on instance-level consistency objectives that enforce stability of individual node (or node-pair) embeddings. Due to optimizing nodes in isolation, these methods fail to maintain global relational structure, causing inter-node correspondences to progressively distort under continual learning. To this end, we propose a novel Structure-Aware Optimal Transport (SAOT) framework that explicitly captures and preserves relational structure within graph representations across sequential tasks. Specifically, SAOT leverages optimal transport theory to capture global inter-node correspondences, thereby facilitating and enhancing graph representation learning. Simultaneously, SAOT incorporates a cross-task knowledge distillation mechanism to preserve the previous structural knowledge. Extensive experiments on four CGL benchmark datasets demonstrate that SAOT outperforms existing self-supervised baselines. In particular, SAOT achieves significant performance gains, improving average accuracy by up to 5% on CoraFull-CL and over 15% on Products-CL compared with state-of-the-art methods in the Class-IL setting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2a77ad3f-fdd4-4dba-af45-1a4ffb31b5aeBuilds on7
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Co2L: Contrastive Continual LearningHyuntak Cha, Jaeho Lee, Jinwoo ShinICCV 2021 · 391 citations
- When Does Self-Supervision Help Graph Convolutional Networks?Yuning You, Tianlong Chen, Zhangyang Wang, Yang ShenICML 2020 · 250 citations
- A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision TasksSara Babakniya, Zalan Fabian, Chaoyang He, Mahdi Soltanolkotabi et al.NeurIPS 2023 · 100 citations
- Multimodal Continual Graph Learning with Neural Architecture SearchJie Cai, Xin Wang, Chaoyu Guan, Yateng Tang et al.WWW 2022 · 50 citations
Related papers
- GALOPA: Graph Transport Learning with Optimal Plan AlignmentYejiang Wang, Yuhai Zhao, Daniel Zhengkui Wang, Ling LiNeurIPS 2023 · 15 citations
- ST-GCond: Self-supervised and Transferable Graph Dataset CondensationBeining Yang, Qingyun Sun, Cheng Ji, Xingcheng Fu et al.ICLR 2025
- From Distribution to Geometry: Stable Graph Generalization via Invariant BarycentersHangyuan Du, Rong Wang, Weihong Zhang, Lu Bai et al.ICML 2026
- GCL-OT: Graph Contrastive Learning with Optimal Transport for Heterophilic Text-Attributed GraphsYating Ren, Yikun Ban, Huobin TanAAAI 2026
- Towards Continual Knowledge Graph Embedding via Incremental DistillationJiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang et al.AAAI 2024 · 52 citations
