Trimming the Fat: Redundancy-Aware Acceleration Framework for DGNNs
Renhong Huang, Yuxuan Cao, Yi Li, Junwei Hu, Zihua Xiong, Shuai Fang, Sheng Guo, Bo Zheng, Yang Yang
摘要
Temporal graphs are essential for modeling complex real-world systems, such as social interactions, financial transactions, and recommendation systems, but the high computational cost and model complexity of dynamic graph neural networks (DGNNs) pose significant challenges for practical deployment. Although various pruning and sampling techniques have proven effective in accelerating static GNNs, they fall short in dynamic settings due to temporal dependencies in evolving graph structures. To address these challenges, we propose TrimDG, a general framework that accelerates DGNNs by eliminating both static and runtime redundancies. For static redundancy, we introduce a novel node influence metric, Temporal Personalized PageRank (TPP), to prune less informative nodes, and employ temporal binning to remove redundant events. For runtime redundancy during training, we develop an adaptive sampling strategy guided by graph information bottleneck and further reduce sampling frequency through temporal batch selector and sampling cache. Theoretical analysis supports our design, and experiments on real-world datasets show that TrimDG reduces runtime by an average of 83.49% across diverse DGNN backbones, while maintaining strong predictive performance, demonstrating both its efficiency and generalizability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper21
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer 等NeurIPS 2021 · 被引用 3,862 次
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen 等NeurIPS 2020 · 被引用 3,042 次
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 被引用 1,599 次
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan 等ICLR 2020 · 被引用 1,155 次
- Inductive representation learning on temporal graphsDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar 等ICLR 2020 · 被引用 901 次
相关 Paper
- Zebra: When Temporal Graph Neural Networks Meet Temporal Personalized PageRankYiming Li, Yanyan Shen, Lei Chen, Mingxuan YuanVLDB 2023 · 被引用 67 次
- CompressGNN: Accelerating Graph Neural Network Training via Hierarchical CompressionZheng Chen, Feng Zhang, Yifei Xia, Wentao Zhang 等KDD 2025 · 被引用 1 次
- Cascade: A Dependency-aware Efficient Training Framework for Temporal Graph Neural NetworkYue Dai, Xulong Tang, Youtao ZhangASPLOS 2025 · 被引用 4 次
- ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic GraphsShihong Gao, Yiming Li, Yanyan Shen, Yingxia Shao 等VLDB 2024 · 被引用 32 次
- OUTRE: An OUT-of-core De-REdundancy GNN Training Framework for Massive Graphs within A Single MachineZeang Sheng, Wentao Zhang, Yangyu Tao, Bin CuiVLDB 2024 · 被引用 17 次
