Tunable LLM-based Proactive Recommendation Agent
Mingze Wang, Chongming Gao, Wenjie Wang, Yangyang Li, Fuli Feng
Abstract
Recommender systems are indispensable on various digital platforms. However, traditional methods often reinforce existing user interests, which leads to echo chambers and limits diversity. Proactive Recommendation Systems (PRS) aim to address this issue by cultivating users’ latent interests through multi-step recommendations. Despite advancements, challenges persist particularly in optimizing long-term rewards and adapting to real-time user feed-back. In this study, we propose an LLM-based Actor-Critic Agent framework to enhance PRS. This framework utilizes the LLM-based agent to adjust recommendations in real time based on feedback and employs agent-tuning meth-ods to optimize long-term rewards using three proposed reward functions. Extensive experiments validate the significant superiority of this framework over existing methods by optimizing long-term rewards and dynamically evolving with user feedback. Our codes are available at https://github.com/gnaWeinrE/T-PRA .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Uncertainty-aware Generative RecommendationChenxiao Fan, Chongming Gao, Yaxin Gong, Haoyan Liu et al.KDD 2026 · 2 citations
- ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient EstimationHongru Hou, Tiehua Mei, Denghui Geng, Jinhui Huang et al.ICML 2026
Builds on19
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
- Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
Related papers
- Adaptive Preference Arithmetic: A Personalized Agent with Adaptive Preference Arithmetic for Dynamic Preference ModelingHongyi Nie, Yaqing Wang, Mingyang Zhou, Feiyang Pan et al.NeurIPS 2025 · 1 citation
- ITMPRec: Intention-based Targeted Multi-round Proactive RecommendationYahong Lian, Chunyao Song, Tingjian GeWWW 2025 · 6 citations
- RecCocktail: A Generalizable and Efficient Framework for LLM-Based RecommendationMin Hou, Chenxi Bai, Le Wu, Hao Liu et al.AAAI 2026 · 2 citations
- ProMax: Exploring the Potential of LLM-derived Profiles with Distribution Shaping for Recommender SystemsYi Zhang, Yiwen Zhang, Kai Zheng, Tong Chen et al.SIGIR 2026
- PolicySim: An LLM-Based Agent Social Simulation Sandbox for Proactive Policy OptimizationRenhong Huang, Ning Tang, Jiarong Xu, Yuxuan Cao et al.WWW 2026
