MixGCF: An Improved Training Method for Graph Neural Network-based Recommender Systems
Tinglin Huang, Yuxiao Dong, Ming Ding, Zhen Yang, Wenzheng Feng, Xinyu Wang, Jie Tang
Abstract
Graph neural networks (GNNs) have recently emerged as state-of-the-art collaborative filtering (CF) solution. A fundamental challenge of CF is to distill negative signals from the implicit feedback, but negative sampling in GNN-based CF has been largely unexplored. In this work, we propose to study negative sampling by leveraging both the user-item graph structure and GNNs' aggregation process. We present the MixGCF method---a general negative sampling plugin that can be directly used to train GNN-based recommender systems. In MixGCF, rather than sampling raw negatives from data, we design the hop mixing technique to synthesize hard negatives. Specifically, the idea of hop mixing is to generate the synthetic negative by aggregating embeddings from different layers of raw negatives' neighborhoods. The layer and neighborhood selection process are optimized by a theoretically-backed hard selection strategy. Extensive experiments demonstrate that by using MixGCF, state-of-the-art GNN-based recommendation models can be consistently and significantly improved, e.g., 26% for NGCF and 22% for LightGCN in terms of [email protected]
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c3cb0d95-4abf-43f9-824c-2a216c6a7f45Cited by top-tier papers40
- Are Graph Augmentations Necessary?: Simple Graph Contrastive Learning for RecommendationJunliang Yu, Hongzhi Yin, Xin Xia, Tong Chen et al.SIGIR 2022 · 658 citations
- Linear-Time Graph Neural Networks for Scalable RecommendationsJiahao Zhang, Rui Xue, Wenqi Fan, Xin Xu et al.WWW 2024 · 63 citations
- HICF: Hyperbolic Informative Collaborative FilteringMenglin Yang, Zhihao Li, Min Zhou, Jiahong Liu et al.KDD 2022 · 54 citations
- Mitigating the Popularity Bias of Graph Collaborative Filtering: A Dimensional Collapse PerspectiveYifei Zhang, Hao Zhu, Yankai Chen, Zixing Song et al.NeurIPS 2023 · 47 citations
- ApeGNN: Node-Wise Adaptive Aggregation in GNNs for RecommendationDan Zhang, Yifan Zhu, Yuxiao Dong, Yuandong Wang et al.WWW 2023 · 43 citations
Builds on10
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Hard Negative Mixing for Contrastive LearningYannis Kalantidis, Mert Bülent Sariyildiz, Noé Pion, Philippe Weinzaepfel et al.NeurIPS 2020 · 805 citations
- Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network ApproachLei Chen, Le Wu, Richang Hong, Kun Zhang et al.AAAI 2020 · 634 citations
- On Sampled Metrics for Item RecommendationWalid Krichene, Steffen RendleKDD 2020 · 459 citations
- CKAN: Collaborative Knowledge-aware Attentive Network for Recommender SystemsZe Wang, Guangyan Lin, Huobin Tan, Qinghong Chen et al.SIGIR 2020 · 311 citations
Related papers
- Candidate-aware Graph Contrastive Learning for RecommendationWei He, Guohao Sun, Jinhu Lu, Xiu Susie FangSIGIR 2023 · 64 citations
- Automated Self-Supervised Learning for RecommendationLianghao Xia, Chao Huang, Chunzhen Huang, Kangyi Lin et al.WWW 2023 · 141 citations
- Less is More: Reweighting Important Spectral Graph Features for RecommendationShaowen Peng, Kazunari Sugiyama, Tsunenori MineSIGIR 2022 · 44 citations
- Graph Neural Transport Networks with Non-local Attentions for Recommender SystemsHuiyuan Chen, Chin-Chia Michael Yeh, Fei Wang, Hao YangWWW 2022 · 44 citations
- Enhanced Graph Learning for Collaborative Filtering via Mutual Information MaximizationYonghui Yang, Le Wu, Richang Hong, Kun Zhang et al.SIGIR 2021 · 112 citations
