Lune

ICDE2024Top-tier venue

Meta-Optimized Joint Generative and Contrastive Learning for Sequential Recommendation

Yongjing Hao, Pengpeng Zhao, Junhua Fang, Jianfeng Qu, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng, Xiaofang Zhou

Abstract

Sequential Recommendation (SR) has received increasing attention due to its ability to capture user dynamic preferences. Recently, Contrastive Learning (CL) provides an effective approach for sequential recommendation by learning invariance from different views of an input. However, most existing data or model augmentation methods may destroy semantic sequential interaction characteristics and often rely on the hand-crafted property of their contrastive view-generation strategies. In this paper, we propose a Meta-optimized Seq2Seq Generator and Contrastive Learning (Meta-SGCL) for sequential recommendation, which applies the meta-optimized two-step training strategy to adaptive generate contrastive views. Specifically, Meta-SGCL first introduces a simple yet effective augmentation method called Sequence-to-Sequence (Seq2Seq) generator, which treats the Variational AutoEncoders (VAE) as the view generator and can constitute contrastive views while preserving the original sequence's semantics. Next, the model employs a meta-optimized two-step training strategy, which aims to adaptively generate contrastive views without relying on manually designed view-generation techniques. Finally, we evaluate our proposed method Meta-SGCL using three public real-world datasets. Compared with the state-of-the-art methods, our experimental results demonstrate the effectiveness of our model and the code is available.11https.//anonymous.4open.science/status/Meta-SGCL-05B5

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale cites A Simple Framework for Contrastive Learning of Visual Representations
  • Swin Transformer: Hierarchical Vision Transformer using Shifted Windows cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  • SimCSE: Simple Contrastive Learning of Sentence Embeddings cites A Simple Framework for Contrastive Learning of Visual Representations
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. One Battle After Another: Probing LLMs' Limits on Multi-Turn Instruction Following with a Benchmark Evolving FrameworkQi Jia, Ye Shen, Xiujie Song, Kaiwei Zhang et al.ACL 2026 · 3 citations

Builds on11

  1. Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
  2. A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
  3. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
  4. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
  5. MAMO: Memory-Augmented Meta-Optimization for Cold-start RecommendationManqing Dong, Feng Yuan, Lina Yao, Xiwei Xu et al.KDD 2020 · 161 citations

Related papers

  1. Meta-optimized Contrastive Learning for Sequential RecommendationXiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang et al.SIGIR 2023 · 57 citations
  2. Meta-optimized Structural and Semantic Contrastive Learning for Graph Collaborative FilteringYongjing Hao, Pengpeng Zhao, Jianfeng Qu, Lei Zhao et al.ICDE 2024 · 1 citation
  3. Adaptive Contrastive Learning in Sequential Recommendation based on Perturbation and Restoration NetworksYanbo Zhou, Bin Lü, Xu-Hua Yang, Xin-Li Xu et al.WWW 2026
  4. Semantic Retrieval Augmented Contrastive Learning for Sequential RecommendationZiqiang Cui, Yunpeng Weng, Xing Tang, Xiaokun Zhang et al.NeurIPS 2025 · 17 citations
  5. Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationPeilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao et al.WWW 2024 · 36 citations
Dusk over the sea between two cliffs drawn in fine vertical lines