De-collapsing User Intent: Adaptive Diffusion Augmentation with Mixture-of-Experts for Sequential Recommendation
Xiaoxi Cui, Chao Zhao, Yurong Cheng, Xiangmin Zhou
Abstract
Sequential recommendation (SR) aims to predict users' next action based on their historical behavior, and is widely adopted by a number of platforms. The performance of SR models relies on rich interaction data. However, in real-world scenarios, many users only have a few historical interactions, leading to the problem of data sparsity. Data sparsity not only leads to model overfitting on sparse sequences, but also hinders the model's ability to capture the underlying hierarchy of user intents. This results in misinterpreting the user's true intents and recommending irrelevant items. Existing data augmentation methods attempt to mitigate overfitting by generating relevant and varied data. However, they overlook the problem of reconstructing the user's intent hierarchy, which is lost in sparse data. Consequently, the augmented data often fails to align with the user's true intents, potentially leading to misguided recommendations. To address this, we propose the Adaptive Diffusion Augmentation for Recommendation (ADARec) framework. Critically, instead of using a diffusion model as a black-box generator, we use its entire step-wise denoising trajectory to reconstruct a user's intent hierarchy from a single sparse sequence. To ensure both efficiency and effectiveness, our framework adaptively determines the required augmentation depth for each sequence and employs a specialized mixture-of-experts architecture to decouple coarse-and fine-grained intents. Experiments show ADARec outperforms state-of-the-art methods on standard benchmarks and on sparse sequences, demonstrating its ability to reconstruct hierarchical intent representations from sparse data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on15
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Contrastive Learning for Sequential RecommendationXu Xie, Fei Sun, Zhaoyang Liu, Shiwen Wu et al.ICDE 2022 · 674 citations
- Sequential Recommendation with Graph Neural NetworksJianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui et al.SIGIR 2021 · 435 citations
- Intent Contrastive Learning for Sequential RecommendationYongjun Chen, Zhiwei Liu, Jia Li, Julian J. McAuley et al.WWW 2022 · 429 citations
- Filter-enhanced MLP is All You Need for Sequential RecommendationKun Zhou, Hui Yu, Wayne Xin Zhao, Ji-Rong WenWWW 2022 · 411 citations
Related papers
- Intent-aware Diffusion with Contrastive Learning for Sequential RecommendationYuanpeng Qu, Hajime NobuharaSIGIR 2025 · 24 citations
- Plug-In Diffusion Model for Sequential RecommendationHaokai Ma, Ruobing Xie, Lei Meng, Xin Chen et al.AAAI 2024 · 84 citations
- Sparse Enhanced Network: An Adversarial Generation Method for Robust Augmentation in Sequential RecommendationJunyang Chen, Guoxuan Zou, Pan Zhou, Yirui Wu et al.AAAI 2024 · 20 citations
- A Generic Behavior-Aware Data Augmentation Framework for Sequential RecommendationJing Xiao, Weike Pan, Zhong MingSIGIR 2024 · 8 citations
- Adaptive User Dynamic Interest Guidance for Generative Sequential RecommendationKai Zhu, Jing Li, Jia Wu, Yue He et al.SIGIR 2025 · 1 citation
