Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
Ziqiang Cui, Yunpeng Weng, Xing Tang, Xiaokun Zhang, Shiwei Li, Peiyang Liu, Bowei He, Dugang Liu, Weihong Luo, Xiuqiang He, Chen Ma
Abstract
Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt user preference patterns or depend on sparse collaborative data that generates unreliable contrastive pairs. Furthermore, existing approaches typically require predefined selection rules that impose strong assumptions, limiting the model's ability to autonomously learn optimal contrastive pairs. To address these limitations, we propose a novel approach named Semantic Retrieval Augmented Contrastive Learning (SRA-CL). SRA-CL leverages the semantic understanding and reasoning capabilities of LLMs to generate expressive embeddings that capture both user preferences and item characteristics. These semantic embeddings enable the construction of candidate pools for inter-user and intra-user contrastive learning through semantic-based retrieval. To further enhance the quality of the contrastive samples, we introduce a learnable sample synthesizer that optimizes the contrastive sample generation process during model training. SRA-CL adopts a plug-and-play design, enabling seamless integration with existing sequential recommendation architectures. Extensive experiments on four public datasets demonstrate the effectiveness and model-agnostic nature of our approach. Our code is available at https://github.com/ziqiangcui/SRA-CL * Equal contribution.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 90332660-be44-4f3a-98a1-2cbfa891c958Cited by top-tier papers3
- Queries Are Not Alone: Clustering Text Embeddings for Video SearchPeiyang Liu, Xi Wang, Ziqiang Cui, Wei YeSIGIR 2025 · 8 citations
- Can Recommender Systems Teach Themselves? A Recursive Self-Improving Framework with Fidelity ControlLuankang Zhang, Hao Wang, Zhongzhou Liu, MINGJIA YIN et al.ICML 2026 · 5 citations
- From Token to Item: Enhancing Large Language Models for Recommendation via Item-aware Attention MechanismXiaokun Zhang, Bowei He, Jiamin Chen, Ziqiang Cui et al.WWW 2026
Builds on24
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
- Contrastive Learning for Sequential RecommendationXu Xie, Fei Sun, Zhaoyang Liu, Shiwen Wu et al.ICDE 2022 · 674 citations
Related papers
- Meta-Optimized Joint Generative and Contrastive Learning for Sequential RecommendationYongjing Hao, Pengpeng Zhao, Junhua Fang, Jianfeng Qu et al.ICDE 2024 · 9 citations
- Meta-optimized Contrastive Learning for Sequential RecommendationXiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang et al.SIGIR 2023 · 57 citations
- Interest Entropy: Rethinking Contrastive Learning for Sequential Recommendation with Interest UncertaintyBinquan Wu, Kun Zeng, Yicheng Luo, Junhao Zheng et al.KDD 2026
- Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao et al.WWW 2024 · 36 citations
- Adaptive Contrastive Learning in Sequential Recommendation based on Perturbation and Restoration NetworksYanbo Zhou, Bin Lü, Xu-Hua Yang, Xin-Li Xu et al.WWW 2026
