Learning Recommender Systems with Implicit Feedback via Soft Target Enhancement
Mingyue Cheng, Fajie Yuan, Qi Liu, Shenyang Ge, Zhi Li, Runlong Yu, Defu Lian, Senchao Yuan, Enhong Chen
Abstract
One-hot encoder accompanied by a softmax loss has become the default configuration to deal with the multiclass problem, and is also prevalent in deep learning (DL) based recommender systems (RS). The standard learning process of such methods is to fit the model outputs to a one-hot encoding of the ground truth, referred to as the hard target. However, it is known that these hard targets largely ignore the ambiguity of unobserved feedback in RS, and thus may lead to sub-optimal generalization performance. In this work, we propose SoftRec, a new RS optimization framework to enhance item recommendation. The core idea is that we add additional supervisory signals - well-designed soft targets - for each instance so as to better guide the recommender learning. Meanwhile, we carefully investigate the impacts of specific soft target distributions by instantiating the SoftRec with a series of strategies, including item-based, user-based, and model-based. To verify the effectiveness of SoftRec, we conduct extensive experiments on two public recommendation datasets by using various deep recommendation architectures. The experimental results show that our methods achieve superior performance compared with the standard optimization approaches. Moreover, SoftRec could also exhibit strong performance in cold-start scenarios where user-item interaction has higher sparsity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e7cb803e-8a46-4563-9313-8fb87c41080cCited by top-tier papers3
- FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series ClassificationMingyue Cheng, Qi Liu, Zhiding Liu, Zhi Li et al.WWW 2023 · 64 citations
- Towards Automatic Discovering of Deep Hybrid Network Architecture for Sequential RecommendationMingyue Cheng, Zhiding Liu, Qi Liu, Shenyang Ge et al.WWW 2022 · 36 citations
- MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized GenerationShuo Yu, Mingyue Cheng, Daoyu Wang, Qi Liu et al.WWW 2026 · 3 citations
Builds on8
- On Sampled Metrics for Item RecommendationWalid Krichene, Steffen RendleKDD 2020 · 459 citations
- Parameter-Efficient Transfer from Sequential Behaviors for User Modeling and RecommendationFajie Yuan, Xiangnan He, Alexandros Karatzoglou, Liguang ZhangSIGIR 2020 · 155 citations
- Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep LearningZeyuan Allen-Zhu, Yuanzhi LiICLR 2023 · 151 citations
- Personalized Ranking with Importance SamplingDefu Lian, Qi Liu, Enhong ChenWWW 2020 · 98 citations
- A Generic Network Compression Framework for Sequential Recommender SystemsYang Sun, Fajie Yuan, Min Yang, Guoao Wei et al.SIGIR 2020 · 52 citations
Related papers
- GoRec: A Generative Cold-start Recommendation FrameworkHaoyue Bai, Min Hou, Le Wu, Yonghui Yang et al.ACM MM 2023 · 23 citations
- Sharpness-Consistent Cross-Domain Recommendation for Cold-Start ItemsKe Fei, Jingjing Li, Zhekai Du, Hongbo ChenWWW 2026
- Towards Comprehensive Recommender Systems: Time-Aware Unified Recommendations Based on Listwise Ranking of Implicit Cross-Network DataDilruk Perera, Roger ZimmermannAAAI 2020 · 11 citations
- Sharpness-Aware Minimization for Generalized Embedding Learning in Federated RecommendationFengyuan Yu, Xiaohua Feng, Yuyuan Li, Changwang Zhang et al.WWW 2026
- Fairness among New Items in Cold Start Recommender SystemsZiwei Zhu, Jingu Kim, Trung Nguyen, Aish Fenton et al.SIGIR 2021 · 74 citations
