Are Graph Augmentations Necessary?: Simple Graph Contrastive Learning for Recommendation
Junliang Yu, Hongzhi Yin, Xin Xia, Tong Chen, Lizhen Cui, Quoc Viet Hung Nguyen
摘要
Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling the data sparsity issue. A typical pipeline of CL-based recommendation models is first augmenting the user-item bipartite graph with structure perturbations, and then maximizing the node representation consistency between different graph augmentations. Although this paradigm turns out to be effective, what underlies the performance gains is still a mystery. In this paper, we first experimentally disclose that, in CL-based recommendation models, CL operates by learning more uniform user/item representations that can implicitly mitigate the popularity bias. Meanwhile, we reveal that the graph augmentations, which used to be considered necessary, just play a trivial role. Based on this finding, we propose a simple CL method which discards the graph augmentations and instead adds uniform noises to the embedding space for creating contrastive views. A comprehensive experimental study on three benchmark datasets demonstrates that, though it appears strikingly simple, the proposed method can smoothly adjust the uniformity of learned representations and has distinct advantages over its graph augmentation-based counterparts in terms of recommendation accuracy and training efficiency. The code is released at https://github.com/Coder-Yu/QRec.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper140
- Representation Learning with Large Language Models for RecommendationXubin Ren, Wei Wei, Lianghao Xia, Lixin Su 等WWW 2024 · 被引用 385 次
- LGMRec: Local and Global Graph Learning for Multimodal RecommendationZhiqiang Guo, Jianjun Li, Guohui Li, Chaoyang Wang 等AAAI 2024 · 被引用 164 次
- Knowledge Graph Self-Supervised Rationalization for RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Chunzhen HuangKDD 2023 · 被引用 151 次
- On Softmax Direct Preference Optimization for RecommendationYuxin Chen, Junfei Tan, An Zhang, Zhengyi Yang 等NeurIPS 2024 · 被引用 126 次
- Multi-Behavior Recommendation with Cascading Graph Convolution NetworksZhiyong Cheng, Sai Han, Fan Liu, Lei Zhu 等WWW 2023 · 被引用 110 次
它引用的顶会 Paper14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna 等NeurIPS 2020 · 被引用 7,049 次
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li 等SIGIR 2020 · 被引用 4,448 次
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen 等NeurIPS 2020 · 被引用 3,042 次
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 被引用 2,496 次
相关 Paper
- LightGCL: Simple Yet Effective Graph Contrastive Learning for RecommendationXuheng Cai, Chao Huang, Lianghao Xia, Xubin RenICLR 2023 · 被引用 99 次
- Debiased Contrastive Learning for Sequential RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Chunzhen Huang 等WWW 2023 · 被引用 199 次
- Candidate-aware Graph Contrastive Learning for RecommendationWei He, Guohao Sun, Jinhu Lu, Xiu Susie FangSIGIR 2023 · 被引用 64 次
- Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao 等WWW 2024 · 被引用 36 次
- Graph Augmentation for RecommendationQianru Zhang, Lianghao Xia, Xuheng Cai, Siu-Ming Yiu 等ICDE 2024 · 被引用 31 次
