Meta-Optimized Joint Generative and Contrastive Learning for Sequential Recommendation
Yongjing Hao, Pengpeng Zhao, Junhua Fang, Jianfeng Qu, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng, Xiaofang Zhou
Abstract
Sequential Recommendation (SR) has received increasing attention due to its ability to capture user dynamic preferences. Recently, Contrastive Learning (CL) provides an effective approach for sequential recommendation by learning invariance from different views of an input. However, most existing data or model augmentation methods may destroy semantic sequential interaction characteristics and often rely on the hand-crafted property of their contrastive view-generation strategies. In this paper, we propose a Meta-optimized Seq2Seq Generator and Contrastive Learning (Meta-SGCL) for sequential recommendation, which applies the meta-optimized two-step training strategy to adaptive generate contrastive views. Specifically, Meta-SGCL first introduces a simple yet effective augmentation method called Sequence-to-Sequence (Seq2Seq) generator, which treats the Variational AutoEncoders (VAE) as the view generator and can constitute contrastive views while preserving the original sequence's semantics. Next, the model employs a meta-optimized two-step training strategy, which aims to adaptively generate contrastive views without relying on manually designed view-generation techniques. Finally, we evaluate our proposed method Meta-SGCL using three public real-world datasets. Compared with the state-of-the-art methods, our experimental results demonstrate the effectiveness of our model and the code is available.11https.//anonymous.4open.science/status/Meta-SGCL-05B5
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f1ed1fa1-cff9-41ec-ab57-75b00a680ee2Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- MAMO: Memory-Augmented Meta-Optimization for Cold-start RecommendationManqing Dong, Feng Yuan, Lina Yao, Xiwei Xu et al.KDD 2020 · 161 citations
Related papers
- Meta-optimized Contrastive Learning for Sequential RecommendationXiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang et al.SIGIR 2023 · 57 citations
- Meta-optimized Structural and Semantic Contrastive Learning for Graph Collaborative FilteringYongjing Hao, Pengpeng Zhao, Jianfeng Qu, Lei Zhao et al.ICDE 2024 · 1 citation
- Adaptive Contrastive Learning in Sequential Recommendation based on Perturbation and Restoration NetworksYanbo Zhou, Bin Lü, Xu-Hua Yang, Xin-Li Xu et al.WWW 2026
- Semantic Retrieval Augmented Contrastive Learning for Sequential RecommendationZiqiang Cui, Yunpeng Weng, Xing Tang, Xiaokun Zhang et al.NeurIPS 2025 · 17 citations
- Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao et al.WWW 2024 · 36 citations
