LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation
Lingyu Mu, Hao Deng, Haibo Xing, Kaican Lin, Zhitong Zhu, Zhengxiao Liu, Zheng Lin, Xiaoyi Zeng, Yu Zhang, Jinxin Hu
Abstract
Recent progress in large language model (LLM) based generative recommendation (GR) shows that leveraging LLM world knowledge can substantially improve performance. However, existing methods rely on fixed, manually designed instructions to generate semantic knowledge and directly incorporate it into GR, which has two limitations: (1) fixed instructions cannot capture the multidimensional heterogeneity of user interests; (2) uncontrollable knowledge fusion may conflict with behavioral signals and harm recommendations. To address these limitations, we propose LWGR, a framework that leverages Lagrangian constraints to transfer users' personalized World knowledge from LLMs into Generative Recommendation. LWGR enhances GR along two axes: knowledge extraction and fusion. It builds user personalized soft instructions to extract behavior-relevant LLM world knowledge. Then, it formulates knowledge fusion as an optimization problem with explicitly bounded performance degradation, solved via a Lagrangian primal–dual method that selectively incorporates beneficial knowledge. We further design two training strategies for different LLM scales and a deployment scheme that combines nearline precomputation with lightweight online serving. Experiments on multiple public datasets and one industrial dataset show that LWGR outperforms eight state-of-the-art baselines by up to 11.23% and brings a 1.35% revenue lift on a large-scale advertising platform, demonstrating its effectiveness and practicality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6a3c2337-7274-4cf1-8c8a-d83d985b3cd7Builds on16
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Retrieval Augmented Language Model Pre-TrainingKelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat et al.ICML 2020 · 2,937 citations
- Recommender Systems with Generative RetrievalShashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan et al.NeurIPS 2023 · 474 citations
- HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural NetworksZhen Dong, Zhewei Yao, Daiyaan Arfeen, Amir Gholami et al.NeurIPS 2020 · 434 citations
- Learning Vector-Quantized Item Representation for Transferable Sequential RecommendersYupeng Hou, Zhankui He, Julian J. McAuley, Wayne Xin ZhaoWWW 2023 · 256 citations
Related papers
- Beyond Factual Queries: A Novel Predictive Retrieval-Augmented GenerationDebo Cheng, Jianfeng Deng, Qingfeng Chen, Jinyi Jie et al.WWW 2026
- Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language ModelsZheng Hu, Zhe Li, Ziyun Jiao, Satoshi Nakagawa et al.AAAI 2025 · 17 citations
- GRAM: Generative Recommendation via Semantic-aware Multi-granular Late FusionSunkyung Lee, Minjin Choi, Eunseong Choi, Hye-young Kim et al.ACL 2025
- Align³GR: Unified Multi-Level Alignment for LLM-based Generative RecommendationWencai Ye, Mingjie Sun, Shuhang Chen, Wenjin Wu et al.AAAI 2026 · 2 citations
- LEARN: Knowledge Adaptation from Large Language Model to Recommendation for Practical Industrial ApplicationJian Jia, Yipei Wang, Yan Li, Honggang Chen et al.AAAI 2025 · 37 citations
