PRISM: A Training System to Unlock the Potential of Temporal Graph Learning Through Staleness Avoidance
Md Ashraful Islam, Hojae Son, Suhaas Kiran Doddagaddavalli Gangadharaiah, Marco Serafini
Abstract
Training memory-augmented Temporal Graph Neural Networks (M-TGNNs) efficiently and accurately remains challenging due to memory staleness , which arises when temporally dependent events are processed in the same batch and severely degrades accuracy at large batch sizes. We introduce PRISM, an M-TGNN training system that achieves staleness-freedom without giving up GPU parallelism by using multi-versioned memory vectors , so that each event in a batch can consume the memory version that is temporally consistent for it. PRISM formalizes a relaxed notion of staleness-freedom called lazy freshness , which allows for more parallelism than existing staleness-free approaches, and implements it through a multi-versioned memory refinement algorithm over a lightweight memory computation graph. On five temporal-graph benchmarks and three M-TGNN models (TGN, TNCN, APAN), PRISM improves the accuracy of existing models by up to 28% and surpasses the TGB leaderboard by 9.2%, while keeping training time competitive with parallel stale-memory systems (TGL, ETC) and consistently lower than stricter staleness-free baselines. PRISM thus provides a practical, staleness-free foundation for temporal graph learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 59019cb6-ae83-4a01-ab64-373a299a0a68Builds on24
- EvolveGCN: Evolving Graph Convolutional Networks for Dynamic GraphsAldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma et al.AAAI 2020 · 1,429 citations
- Inductive representation learning on temporal graphsDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar et al.ICLR 2020 · 901 citations
- Inductive Representation Learning in Temporal Networks via Causal Anonymous WalksYanbang Wang, Yen-Yu Chang, Yunyu Liu, Jure Leskovec et al.ICLR 2021 · 326 citations
- Streaming Graph Neural NetworksYao Ma, Ziyi Guo, Zhaochun Ren, Jiliang Tang et al.SIGIR 2020 · 210 citations
- ROLAND: Graph Learning Framework for Dynamic GraphsJiaxuan You, Tianyu Du, Jure LeskovecKDD 2022 · 148 citations
Related papers
- DistTGL: Distributed Memory-Based Temporal Graph Neural Network TrainingHongkuan Zhou, Da Zheng, Xiang Song, George Karypis et al.SC 2023 · 21 citations
- PipeTGL: (Near) Zero Bubble Memory-based Temporal Graph Neural Network Training via Pipeline OptimizationJun Liu, Bingqian Du, Ziyue Luo, Sitian Lu et al.VLDB 2025
- MSPipe: Efficient Temporal GNN Training via Staleness-Aware PipelineGuangming Sheng, Junwei Su, Chao Huang, Chuan WuKDD 2024 · 7 citations
- Effective and Efficient Distributed Temporal Graph Learning through Hotspot Memory SharingLongjiao Zhang, Rui Wang, Tongya Zheng, Ziqi Huang et al.VLDB 2025 · 1 citation
- DyFMVP: Say Goodbye to Staleness! Fresh Memory Vigorous Preserver for Continuous-Time Dynamic GraphJianye Pang, Xinjie Zhu, Xiaofei XiongICDE 2025
