Uncertainty-aware Generative Recommendation
Chenxiao Fan, Chongming Gao, Yaxin Gong, Haoyan Liu, Fuli Feng, Xiangnan He
Abstract
Generative Recommendation has emerged as a transformative paradigm, reformulating recommendation as an end-to-end autoregressive sequence generation task. Despite its promise, existing preference optimization methods typically rely on binary outcome correctness, suffering from a systemic limitation we term uncertainty blindness. This issue manifests in the neglect of the model's intrinsic generation confidence, the variation in sample learning difficulty, and the lack of explicit confidence expression, directly leading to unstable training dynamics and unquantifiable decision risks. In this paper, we propose Uncertainty-aware Generative Recommendation (UGR), a unified framework that leverages uncertainty as a critical signal for adaptive optimization. UGR synergizes three mechanisms: (1) an uncertainty-weighted reward to penalize confident errors; (2) difficulty-aware optimization dynamics to prevent premature convergence; and (3) explicit confidence alignment to empower the model with confidence expression capabilities. Extensive experiments demonstrate that UGR not only yields superior recommendation performance but also fundamentally stabilizes training, preventing the performance degradation often observed in standard methods. Furthermore, the learned confidence enables reliable downstream risk-aware applications. Our project repository is available at: https://github.com/cxfann/UGR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 707de7a7-fb26-45f4-a8f7-15fc0cebb4a4Builds on19
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- Recommender Systems with Generative RetrievalShashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan et al.NeurIPS 2023 · 474 citations
- Autoregressive Image Generation using Residual QuantizationDoyup Lee, Chiheon Kim, Saehoon Kim, Minsu Cho et al.CVPR 2022 · 184 citations
- Adapting Large Language Models by Integrating Collaborative Semantics for RecommendationBowen Zheng, Yupeng Hou, Hongyu Lu, Yu Chen et al.ICDE 2024 · 132 citations
Related papers
- APAO: Bridging the Training-Inference Gap in Generative Recommendation via Adaptive Prefix-Aware OptimizationYuanqing Yu, Yifan Wang, Weizhi Ma, Zhiqiang Guo et al.KDD 2026 · 4 citations
- Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation ModelLuankang Zhang, Kenan Song, Yi Quan Lee, Wei Guo et al.SIGIR 2025 · 5 citations
- Adaptive Mix Preference Optimization for Generative RecommendationJunbo Qi, Yanyan Zou, Xuanhua Yang, Sulong Xu et al.SIGIR 2026
- Ctrl-U: Robust Conditional Image Generation via Uncertainty-aware Reward ModelingGuiyu Zhang, Huan-ang Gao, Zijian Jiang, Hao Zhao et al.ICLR 2025
- Generative Recommender with End-to-End Learnable Item TokenizationEnze Liu, Bowen Zheng, Cheng Ling, Lantao Hu et al.SIGIR 2025 · 11 citations
