Interest Entropy: Rethinking Contrastive Learning for Sequential Recommendation with Interest Uncertainty
Binquan Wu, Kun Zeng, Yicheng Luo, Junhao Zheng, Qianli Ma
Abstract
Sequential Recommendation predicts the next item based on users' past behaviors, but sparse interaction data makes user preferences hard to learn. Recently, contrastive learning has shown promise in this area. It augments data to form positive pairs and maximizing their similarity, allowing the model to learn more generalizable user interests. However, they mainly adopt uniform augmentation and alignment to all sequences, ignoring the challenges arising from their distinct interest structure, namely semantic discrepancy and semantic bias. In this paper, we first study the impact of augmentation on sequence's semantic through Interest Entropy, which measures the diversity and density of interest distribution. Our finding shows only a small fraction of sequences are stable under perturbation. These sequences mainly exhibit low or high entropy, reflecting focused or casual interests. This limits the effectiveness of contrastive learning, which relies on semantically consistent positive pairs. Furthermore, with spectral analysis, we show that positive alignment may cause low-entropy sequences to overlook niche interests, while high-entropy sequences may amplify interest-irrelevant signals, which we term semantic bias. Finally, based on Interest Entropy, we propose IERec, a simple yet effective mutual retrieval augmented contrastive learning method that mitigates the above issues in a unified manner. For each anchor sequence (those with low or high entropy), we retrieve semantically similar sequences with complementary entropy, and concatenate them to form a positive view. Sequences that are easily affected, mainly those with medium entropy, are excluded from augmentation. This approach can avoid harmful semantic discrepancy of positive pairs and reduce the effect of the semantic bias, leading to improved performance. Moreover, using interest entropy to guide contrastive learning can further improve existing CL-based SR methods.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 4cd779d5-a840-4d69-a55d-930cb32d6123Related papers
- Semantic Retrieval Augmented Contrastive Learning for Sequential RecommendationZiqiang Cui, Yunpeng Weng, Xing Tang, Xiaokun Zhang et al.NeurIPS 2025 · 17 citations
- Debiased Contrastive Learning for Sequential RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Chunzhen Huang et al.WWW 2023 · 199 citations
- Adaptive Contrastive Learning in Sequential Recommendation based on Perturbation and Restoration NetworksYanbo Zhou, Bin Lü, Xu-Hua Yang, Xin-Li Xu et al.WWW 2026
- Meta-optimized Contrastive Learning for Sequential RecommendationXiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang et al.SIGIR 2023 · 57 citations
- Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao et al.WWW 2024 · 36 citations
