Lune

KDD2025Top-tier venue

Multi-Grained Preference Enhanced Transformer for Multi-Behavior Sequential Recommendation

Chuan He, Yongchao Liu, Qiang Li, Weiqiang Wang, Xing Fu, Xinyi Fu, Chuntao Hong, Xinwei Yao

Abstract

Sequential recommendation (SR) aims to predict the next purchasing item according to users' dynamic preference learned from their historical user-item interactions. To improve the performance of recommendation, learning dynamic heterogeneous cross-type behavior dependencies is indispensable for recommender system. However, there still exists some challenges in Multi-Behavior Sequential Recommendation (MBSR). On the one hand, existing methods only model heterogeneous multi-behavior dependencies at behavior-level or item-level, and modeling interaction-level dependencies is still a challenge. On the other hand, the dynamic multi-grained behavior-aware preference is hard to capture in interaction sequences, which reflects interaction-aware sequential pattern. To tackle these challenges, we propose a Multi-Grained Preference enhanced Transformer framework (M-GPT). First, M-GPT constructs an interaction-level graph of historical cross-typed interactions in a sequence. Then graph convolution is performed to derive interaction-level multi-behavior dependency representation repeatedly, in which the complex correlation between historical cross-typed interactions at specific orders can be well learned. Secondly, a novel multifaceted transformer architecture equipped with multi-grained user preference extraction is proposed to encode the interaction-aware sequential pattern enhanced by capturing temporal behavior-aware multi-grained preference . Experiments on the real-world datasets indicate that our method M-GPT consistently outperforms various state-of-the-art recommendation methods. Our code is available at: https://github.com/hchchchchchchc/MGPT.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Sequential Recommendation with Graph Neural Networks cites LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
  • Sequential Recommendation with Graph Neural Networks cites Multi-behavior Recommendation with Graph Convolutional Networks
  • Multi-behavior Recommendation with Graph Convolutional Networks cites LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
  • Graph Meta Network for Multi-Behavior Recommendation cites LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
  • Graph Meta Network for Multi-Behavior Recommendation cites Multi-behavior Recommendation with Graph Convolutional Networks
  • From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation cites Multi-behavior Recommendation with Graph Convolutional Networks
  • From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation cites Graph Meta Network for Multi-Behavior Recommendation
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential RecommendationRuochen Yang, Xiaodong Li, Jiawei Sheng, Jiangxia Cao et al.KDD 2026

Builds on19

  1. LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
  2. Sequential Recommendation with Graph Neural NetworksJianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui et al.SIGIR 2021 · 435 citations
  3. Multi-behavior Recommendation with Graph Convolutional NetworksBowen Jin, Chen Gao, Xiangnan He, Depeng Jin et al.SIGIR 2020 · 420 citations
  4. Next-item Recommendation with Sequential HypergraphsJianling Wang, Kaize Ding, Liangjie Hong, Huan Liu et al.SIGIR 2020 · 284 citations
  5. Graph Meta Network for Multi-Behavior RecommendationLianghao Xia, Yong Xu, Chao Huang, Peng Dai et al.SIGIR 2021 · 219 citations

Related papers

  1. Multi-Behavior Hypergraph-Enhanced Transformer for Sequential RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Yuxuan Liang et al.KDD 2022 · 165 citations
  2. Multi-Behavior Sequential Transformer RecommenderEnming Yuan, Wei Guo, Zhicheng He, Huifeng Guo et al.SIGIR 2022 · 97 citations
  3. Personalized Behavior-Aware Transformer for Multi-Behavior Sequential RecommendationJiajie Su, Chaochao Chen, Zibin Lin, Xi Li et al.ACM MM 2023 · 47 citations
  4. Explicit and Implicit Modeling via Dual-Path Transformer for Behavior Set-informed Sequential RecommendationMing Chen, Weike Pan, Zhong MingKDD 2024 · 9 citations
  5. Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior RecommendationLianghao Xia, Chao Huang, Yong Xu, Peng Dai et al.AAAI 2021 · 251 citations
Dusk over the sea between two cliffs drawn in fine vertical lines