Mitigating the Popularity Bias of Graph Collaborative Filtering: A Dimensional Collapse Perspective
Yifei Zhang, Hao Zhu, Yankai Chen, Zixing Song, Piotr Koniusz, Irwin King
Abstract
Graph Collaborative Filtering (GCF) is widely used in personalized recommendation systems. However, GCF suffers from a fundamental problem where features tend to occupy the embedding space inefficiently (by spanning only a low-dimensional subspace). Such an effect is characterized in GCF by the embedding space being dominated by a few of popular items with the user embeddings highly concentrated around them. This enhances the so-called Matthew effect of the popularity bias where popular items are highly recommend whereas remaining items are ignored. In this paper, we analyze the above effect in GCF and reveal that the simplified graph convolution operation (typically used in GCF) shrinks the singular space of the feature matrix. As typical approaches ( i.e ., optimizing the uniformity term) fail to prevent the embedding space degradation, we propose a decorrelation-enhanced GCF objective that promotes feature diversity by leveraging the so-called principle of redundancy reduction in embeddings. However, unlike conventional methods that use the Euclidean geometry to relax hard constraints for decorrelation, we exploit non-Euclidean geometry. Such a choice helps maintain the range space of the matrix and obtain small condition number, which prevents the embedding space degradation. Our method outperforms contrastive-based GCF models on several benchmark datasets and improves the performance for unpopular items.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf6df47b-b9a8-4473-9073-e63192978f27Cited by top-tier papers15
- Intelligent Model Update Strategy for Sequential RecommendationZheqi Lv, Wenqiao Zhang, Zhengyu Chen, Shengyu Zhang et al.WWW 2024 · 53 citations
- A Diffusion-Based Pre-training Framework for Crystal Property PredictionZixing Song, Ziqiao Meng, Irwin KingAAAI 2024 · 25 citations
- Federated Graph Learning for Cross-Domain RecommendationZiqi Yang, Zhaopeng Peng, Zihui Wang, Jianzhong Qi et al.NeurIPS 2024 · 24 citations
- Popularity-Aware Alignment and Contrast for Mitigating Popularity BiasMiaomiao Cai, Lei Chen, Yifan Wang, Haoyue Bai et al.KDD 2024 · 23 citations
- Influential Exemplar Replay for Incremental Learning in Recommender SystemsXinni Zhang, Yankai Chen, Chenhao Ma, Yixiang Fang et al.AAAI 2024 · 21 citations
Builds on29
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
Related papers
- AFDGCF: Adaptive Feature De-correlation Graph Collaborative Filtering for RecommendationsWei Wu, Chao Wang, Dazhong Shen, Chuan Qin et al.SIGIR 2024 · 33 citations
- Investigating Accuracy-Novelty Performance for Graph-based Collaborative FilteringMinghao Zhao, Le Wu, Yile Liang, Lei Chen et al.SIGIR 2022 · 70 citations
- HyCoRec: Hypergraph-Enhanced Multi-Preference Learning for Alleviating Matthew Effect in Conversational RecommendationYongsen Zheng, Ruilin Xu, Ziliang Chen, Guohua Wang et al.ACL 2024
- How Powerful is Graph Filtering for RecommendationShaowen Peng, Xin Liu, Kazunari Sugiyama, Tsunenori MineKDD 2024 · 16 citations
- Rethinking Popularity Bias in Collaborative Filtering via Analytical Vector DecompositionLingfeng Liu, Yixin Song, Dazhong Shen, Bing Yin et al.KDD 2026
