The Limits of Graph Samplers for Training Inductive Recommender Systems
Theis E. Jendal, Matteo Lissandrini, Peter Dolog, Katja Hose
Abstract
Inductive Recommender Systems are capable of recommending for new users and with new items thus avoiding the need to retrain after new data reaches the system. However, these methods are still trained on all the data available, requiring multiple days to train a single model, without counting hyperparameter tuning. In this work we focus on graph-based recommender systems, i.e., systems that model the data as a heterogeneous network. In other applications, graph sampling allows to study a subgraph and generalize the findings to the original graph. Thus, we investigate the applicability of sampling techniques for this task. We test on three real world datasets, with three state-of-the-art inductive methods, and using six different sampling methods. We find that its possible to maintain performance using only 50% of the training data with up to 86% percent decrease in training time; however, using less training data leads to far worse performance. Further, we find that when it comes to data for recommendations, graph sampling should also account for the temporal dimension. Therefore, we find that if higher data reduction is needed, new graph based sampling techniques should be studied and new inductive methods should be designed.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Inductive Matrix Completion Based on Graph Neural NetworksMuhan Zhang, Yixin ChenICLR 2020 · 273 citations
- Graph Condensation for Graph Neural NetworksWei Jin, Lingxiao Zhao, Shichang Zhang, Yozen Liu et al.ICLR 2022 · 203 citations
- An Attentive Inductive Bias for Sequential Recommendation beyond the Self-AttentionYehjin Shin, Jeongwhan Choi, Hyowon Wi, Noseong ParkAAAI 2024 · 130 citations
- Scaling Up Graph Neural Networks Via Graph CoarseningZengfeng Huang, Shengzhong Zhang, Chong Xi, Tang Liu et al.KDD 2021 · 78 citations
Related papers
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan et al.ICLR 2020 · 1,155 citations
- Resource-Efficient Training for Large Graph Convolutional Networks with Label-Centric Cumulative SamplingMingkai Lin, Wenzhong Li, Ding Li, Yizhou Chen et al.WWW 2022 · 10 citations
- TGL: A General Framework for Temporal GNN Training onBillion-Scale GraphsHongkuan Zhou, Da Zheng, Israt Nisa, Vassilis N. Ioannidis et al.VLDB 2022 · 109 citations
- Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-BatchSaurabh Bajaj, Hui Guan, Marco Serafini, Juelin Liu et al.VLDB 2025 · 19 citations
- A Gain-Tuning Dynamic Negative Sampler for RecommendationQiannan Zhu, Haobo Zhang, Qing He, Zhicheng DouWWW 2022 · 24 citations
