On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders
Wenyu Mao, Jiancan Wu, Guoqing Hu, Zhengyi Yang, Wei Ji, Xiang Wang
Abstract
Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the multistep process relies on discrete approximations, introducing discretization error that creates a trade-off between computational efficiency and recommendation effectiveness. To address this trade-off, we propose TA-Rec, a two-stage framework that achieves one-step generation by smoothing the denoising function during pretraining while alleviating trajectory deviation by aligning with user preferences during fine-tuning. Specifically, to improve the efficiency without sacrificing the recommendation performance, TA-Rec pretrains the denoising model with Temporal Consistency Regularization (TCR), enforcing the consistency between the denoising results across adjacent steps. Thus, we can smooth the denoising function to map the noise as oracle items in one step with bounded error. To further enhance effectiveness, TA-Rec introduces Adaptive Preference Alignment (APA) that aligns the denoising process with user preference adaptively based on preference pair similarity and timesteps. Extensive experiments prove that TA-Rec's two-stage objective effectively mitigates the discretization errors-induced trade-off, enhancing both efficiency and effectiveness of diffusion-based recommenders. Our code is available at https://github.com/maowenyu-11/TA-Rec.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8f609088-c0d4-476c-96b7-c355f344e5aeCited by top-tier papers3
- OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization ModelingHaoyang Liu, Jie Wang, Yuyang Cai, Xiongwei Han et al.NeurIPS 2025 · 33 citations
- Denoising Neural Reranker for Recommender SystemsWenyu Mao, Shuchang Liu, HailanYang, Xiaobei Wang et al.ICLR 2026 · 4 citations
- Opt-Miner: Empowering Information-Seeking Agent with Tree-Guided Data Synthesis for Optimization ModelingHaoyang Liu, Yuyang Cai, Jie Wang, Xiongwei Han et al.ICML 2026
Builds on37
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
Related papers
- Beyond Static Diffusion: Explicitly Modeling Temporal Patterns in Sequential RecommendationYao Wu, Chengyi Liu, Wenqi Fan, Rui ZhangSIGIR 2026
- Generate What You Prefer: Reshaping Sequential Recommendation via Guided DiffusionZhengyi Yang, Jiancan Wu, Zhicai Wang, Xiang Wang et al.NeurIPS 2023 · 205 citations
- FAVE: Flow-based Average Velocity Establishment for Sequential RecommendationKe Shi, Yao Zhang, Feng Guo, Jinyuan Zhang et al.SIGIR 2026
- Adaptive User Dynamic Interest Guidance for Generative Sequential RecommendationKai Zhu, Jing Li, Jia Wu, Yue He et al.SIGIR 2025 · 1 citation
- Enhancing Diffusion Model with Auxiliary Information Mining-Exploration and Efficient Sampling Mechanism for Sequential RecommendationTe Song, Lianyong Qi, Weiming Liu, Fan Wang et al.AAAI 2025 · 3 citations
