CATS: Cluster-Aware Thompson Sampling for Negative Mining in Sequential Recommendation
Giulia Di Teodoro, Federico Siciliano, Nicola Tonellotto, Fabrizio Silvestri
Abstract
Modern sequential recommendation systems often rely on negative sampling to efficiently train models over vast item corpora. However, common strategies such as uniform, popularity-based sampling, or hard-negative mining, often yield uninformative negatives, introduce popularity bias, or suffer from false negatives that hinder model learning. While several studies focus on identifying true negatives, none explore latent item representations to mitigate false negatives issue. We propose CATS (Cluster-Aware Thompson Sampling), an adaptive negative sampling method that balances exploration and exploitation by leveraging unsupervised item clustering and adaptive multi-armed bandit principles. The key insight behind CATS is that false negatives tend to lie in the same cluster as the positive item, whereas true hard negatives are more likely found in nearest clusters. CATS leverages this by adaptively sampling negatives from the positive item's cluster, its neighboring clusters, and the rest of the item space, and decaying the sampling probability from the positive item's cluster over time, reducing the risk of accumulating false negatives during training. Evaluation using state-of-the-art sequential models (SASRec, BERT4Rec, BSARec) and three benchmark datasets (MovieLens-1M, Amazon Beauty and BeerAdvocate) demonstrates that CATS consistently outperforms standard and advanced sampling baselines. Notably, CATS achieves improvements of over 20% in NDCG@10 compared to vanilla sampling methods, and of over 16% compared to more advanced methods. Our findings suggest that incorporating the latent item structure through adaptive sampling strategies like CATS can significantly enhance the performance of sequential recommendation systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- On Sampled Metrics for Item RecommendationWalid Krichene, Steffen RendleKDD 2020 · 459 citations
- MixGCF: An Improved Training Method for Graph Neural Network-based Recommender SystemsTinglin Huang, Yuxiao Dong, Ming Ding, Zhen Yang et al.KDD 2021 · 190 citations
- Simplify and Robustify Negative Sampling for Implicit Collaborative FilteringJingtao Ding, Yuhan Quan, Quanming Yao, Yong Li et al.NeurIPS 2020 · 131 citations
- An Attentive Inductive Bias for Sequential Recommendation beyond the Self-AttentionYehjin Shin, Jeongwhan Choi, Hyowon Wi, Noseong ParkAAAI 2024 · 130 citations
- On the Theories Behind Hard Negative Sampling for RecommendationWentao Shi, Jiawei Chen, Fuli Feng, Jizhi Zhang et al.WWW 2023 · 66 citations
Related papers
- R2NS: Recall and Re-ranking of Negative Samples for Sequential RecommendationYuanzi Li, Xuri Ge, Jingyu Zhao, Yidan Wang et al.WWW 2026
- ESANS: Effective and Semantic-Aware Negative Sampling for Large-Scale Retrieval SystemsHaibo Xing, Kanefumi Matsuyama, Hao Deng, Jinxin Hu et al.WWW 2025 · 7 citations
- Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao et al.WWW 2024 · 36 citations
- CSRec: Rethinking Sequential Recommendation from A Causal PerspectiveXiaoyu Liu, Jiaxin Yuan, Yuhang Zhou, Jingling Li et al.SIGIR 2025 · 7 citations
- Learning Recommenders for Implicit Feedback with Importance ResamplingJin Chen, Defu Lian, Binbin Jin, Kai Zheng et al.WWW 2022 · 39 citations
