Learning-Efficient Yet Generalizable Collaborative Filtering for Item Recommendation
Yuanhao Pu, Xiaolong Chen, Xu Huang, Jin Chen, Defu Lian, Enhong Chen
Abstract
The weighted squared loss is a common component in several Collaborative Filtering (CF) algorithms for item recommendation, including the representative implicit Alternating Least Squares (iALS). Despite its widespread use, this loss function lacks a clear connection to ranking objectives such as Discounted Cumulative Gain (DCG), posing a fundamental challenge in explaining the exceptional ranking performance observed in these algorithms. In this work, we make a breakthrough by establishing a connection between squared loss and ranking metrics through a Taylor expansion of the DCG-consistent surrogate loss-softmax loss. We also discover a new surrogate squared loss function, namely Ranking-Generalizable Squared (RG 2 ) loss, and conduct thorough theoretical analyses on the DCGconsistency of the proposed loss function. Later, we present an example of utilizing the RG 2 loss with Matrix Factorization (MF), coupled with a generalization upper bound and an ALS optimization algorithm that leverages closed-form solutions over all items. Experimental results over three public datasets demonstrate the effectiveness of the RG 2 loss, exhibiting ranking performance on par with, or even surpassing, the softmax loss while achieving faster convergence. Introduction Collaborative filtering is a typical technique in item recommendations that leverages similarities between user behav-
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65b06f07-13ce-4c1e-a4ff-b3613c5e0759Cited by top-tier papers2
- Advancing Loss Functions in Recommender Systems: A Comparative Study with a Rényi Divergence-Based SolutionShengjia Zhang, Jiawei Chen, Changdong Li, Sheng Zhou et al.AAAI 2025 · 6 citations
- From Pairwise to Ranking: Climbing the Ladder to Ideal Collaborative Filtering with Pseudo-RankingYuhan Zhao, Rui Chen, Li Chen, Shuang Zhang et al.AAAI 2025 · 4 citations
Builds on6
- LightRec: A Memory and Search-Efficient Recommender SystemDefu Lian, Haoyu Wang, Zheng Liu, Jianxun Lian et al.WWW 2020 · 106 citations
- Personalized Ranking with Importance SamplingDefu Lian, Qi Liu, Enhong ChenWWW 2020 · 98 citations
- Symmetric Metric Learning with Adaptive Margin for RecommendationMingming Li, Shuai Zhang, Fuqing Zhu, Wanhui Qian et al.AAAI 2020 · 67 citations
- An Alternative Cross Entropy Loss for Learning-to-RankSebastian BruchWWW 2021 · 58 citations
- On the consistency of top-k surrogate lossesForest Yang, Sanmi KoyejoICML 2020 · 54 citations
Related papers
- PSL: Rethinking and Improving Softmax Loss from Pairwise Perspective for RecommendationWeiqin Yang, Jiawei Chen, Xin Xin, Sheng Zhou et al.NeurIPS 2024 · 17 citations
- A Guided Learning Approach for Item Recommendation via Surrogate Loss LearningAhmed Rashed, Josif Grabocka, Lars Schmidt-ThiemeSIGIR 2021 · 10 citations
- Collaborative Residual Metric LearningTianjun Wei, Jianghong Ma, Tommy W. S. ChowSIGIR 2023 · 5 citations
- MCL: Mixed-Centric Loss for Collaborative FilteringZhaolin Gao, Zhaoyue Cheng, Felipe Pérez, Jianing Sun et al.WWW 2022 · 10 citations
- Rethinking and Reweighting the Univariate Losses for Multi-Label Ranking: Consistency and GeneralizationGuoqiang Wu, Chongxuan Li, Kun Xu, Jun ZhuNeurIPS 2021 · 13 citations
