Divergence Meets Consensus: A Multi-Source Negative Sampling Framework for Sequential Recommendation
Yuanzi Li, Lingjie Wang, Jingyu Zhao, Zihang Tian, Yuhan Wang, Lei Wang, Xu Chen
Abstract
Negative sampling is significant for training sequential recommendation models under implicit feedback. The predominant strategy, self-guided hard negative sampling, selects negatives based on the model's current state but suffers from three limitations: (1) the coupling between sampling and model updates triggers a vicious cycle that drives the model into local optima; (2) relying on current model parameters narrows sampling to a small region of the item space, reducing diversity and harming generalization; (3) identifying a hard negative requires scoring the entire candidate pool, causing substantial computational overhead with minimal information gain. To address these challenges, we propose MDCNS (Multi-source Divergence-Consensus for Negative Sampling), a novel ''Teacher-Peer-Self'' framework inspired by Vygotsky's Zone of Proximal Development (ZPD) theory. The proposed method comprises three components, including multi-source scoring, divergence re-ranking, and consensus distillation. Firstly, multi-source scoring incorporates peer and ensemble teacher models to inject external negative signals and break the self-reinforcement loop. Then, divergence re-ranking exploits prediction discrepancy between self and peer models to enhance sampling diversity. Finally, consensus distillation aligns the self-model with the teacher via KL divergence, simultaneously improving computational cost utilization. Extensive experiments on six real-world datasets and five backbone models show that MDCNS consistently outperforms state-of-the-art negative sampling methods, demonstrating strong effectiveness and generalization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8d3af7a7-c178-4514-88e3-cb3391ff56a7Builds on11
- Contrastive Learning for Sequential RecommendationXu Xie, Fei Sun, Zhaoyang Liu, Shiwen Wu et al.ICDE 2022 · 674 citations
- Intent Contrastive Learning for Sequential RecommendationYongjun Chen, Zhiwei Liu, Jia Li, Julian J. McAuley et al.WWW 2022 · 429 citations
- Filter-enhanced MLP is All You Need for Sequential RecommendationKun Zhou, Hui Yu, Wayne Xin Zhao, Ji-Rong WenWWW 2022 · 411 citations
- MixGCF: An Improved Training Method for Graph Neural Network-based Recommender SystemsTinglin Huang, Yuxiao Dong, Ming Ding, Zhen Yang et al.KDD 2021 · 190 citations
- Simplify and Robustify Negative Sampling for Implicit Collaborative FilteringJingtao Ding, Yuhan Quan, Quanming Yao, Yong Li et al.NeurIPS 2020 · 131 citations
Related papers
- R2NS: Recall and Re-ranking of Negative Samples for Sequential RecommendationYuanzi Li, Xuri Ge, Jingyu Zhao, Yidan Wang et al.WWW 2026
- A Gain-Tuning Dynamic Negative Sampler for RecommendationQiannan Zhu, Haobo Zhang, Qing He, Zhicheng DouWWW 2022 · 24 citations
- Diversity-Augmented Negative Sampling for Implicit Collaborative FilteringYueqing Xuan, Kacper Sokol, Mark Sanderson, Jeffrey ChanWWW 2026
- Bidirectional Distillation for Top-K Recommender SystemWonbin Kweon, SeongKu Kang, Hwanjo YuWWW 2021 · 58 citations
- Adaptive Hardness Negative Sampling for Collaborative FilteringRiwei Lai, Rui Chen, Qilong Han, Chi Zhang et al.AAAI 2024 · 40 citations
