Lune

SIGIR2022Top-tier venue

Multi-Behavior Sequential Transformer Recommender

Enming Yuan, Wei Guo, Zhicheng He, Huifeng Guo, Chengkai Liu, Ruiming Tang

Abstract

In most real-world recommender systems, users interact with items in a sequential and multi-behavioral manner. Exploring the fine-grained relationship of items behind the users' multi-behavior interactions is critical in improving the performance of recommender systems. Despite the great successes, existing methods seem to have limitations on modelling heterogeneous item-level multi-behavior dependencies, capturing diverse multi-behavior sequential dynamics, or alleviating data sparsity problems. In this paper, we show it is possible to derive a framework to address all the above three limitations. The proposed framework MB-STR, a Multi-Behavior Sequential Transformer Recommender, is equipped with the multi-behavior transformer layer (MB-Trans), the multi-behavior sequential pattern generator (MB-SPG) and the behavior-aware prediction module (BA-Pred). Compared with a typical transformer, we design MB-Trans to capture multi-behavior heterogeneous dependencies as well as behavior-specific semantics, propose MB-SPG to encode the diverse sequential patterns among multiple behaviors, and incorporate BA-Pred to better leverage multi-behavior supervision. Comprehensive experiments on three real-world datasets show the effectiveness of MB-STR by significantly boosting the recommendation performance compared with various competitive baselines. Further ablation studies demonstrate the superiority of different modules of MB-STR.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

14 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

its abstract · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Multi-Modal Multi-Behavior Sequential Recommendation with Conditional Diffusion-Based Feature Denoising cites Efficient Noise-Decoupling for Multi-Behavior Sequential Recommendation
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers14

  1. Debiased Contrastive Learning for Sequential RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Chunzhen Huang et al.WWW 2023 · 199 citations
  2. LinRec: Linear Attention Mechanism for Long-term Sequential Recommender SystemsLangming Liu, Liu Cai, Chi Zhang, Xiangyu Zhao et al.SIGIR 2023 · 86 citations
  3. Efficient Noise-Decoupling for Multi-Behavior Sequential RecommendationYongqiang Han, Hao Wang, Kefan Wang, Likang Wu et al.WWW 2024 · 60 citations
  4. Personalized Behavior-Aware Transformer for Multi-Behavior Sequential RecommendationJiajie Su, Chaochao Chen, Zibin Lin, Xi Li et al.ACM MM 2023 · 47 citations
  5. Multi-Modal Multi-Behavior Sequential Recommendation with Conditional Diffusion-Based Feature DenoisingXiaoxi Cui, Weihai Lu, Yu Tong, Yiheng Li et al.SIGIR 2025 · 21 citations

Related papers

  1. Multi-Grained Preference Enhanced Transformer for Multi-Behavior Sequential RecommendationChuan He, Yongchao Liu, Qiang Li, Weiqiang Wang et al.KDD 2025 · 1 citation
  2. Multi-Behavior Hypergraph-Enhanced Transformer for Sequential RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Yuxuan Liang et al.KDD 2022 · 165 citations
  3. A Generic Behavior-Aware Data Augmentation Framework for Sequential RecommendationJing Xiao, Weike Pan, Zhong MingSIGIR 2024 · 8 citations
  4. Explicit and Implicit Modeling via Dual-Path Transformer for Behavior Set-informed Sequential RecommendationMing Chen, Weike Pan, Zhong MingKDD 2024 · 9 citations
  5. Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior RecommendationLianghao Xia, Chao Huang, Yong Xu, Peng Dai et al.AAAI 2021 · 251 citations
Dusk over the sea between two cliffs drawn in fine vertical lines