LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation
Lingyu Mu, Hao Deng, Haibo Xing, Kaican Lin, Zhitong Zhu, Zhengxiao Liu, Zheng Lin, Xiaoyi Zeng, Yu Zhang, Jinxin Hu
摘要
Recent progress in large language model (LLM) based generative recommendation (GR) shows that leveraging LLM world knowledge can substantially improve performance. However, existing methods rely on fixed, manually designed instructions to generate semantic knowledge and directly incorporate it into GR, which has two limitations: (1) fixed instructions cannot capture the multidimensional heterogeneity of user interests; (2) uncontrollable knowledge fusion may conflict with behavioral signals and harm recommendations. To address these limitations, we propose LWGR, a framework that leverages Lagrangian constraints to transfer users' personalized World knowledge from LLMs into Generative Recommendation. LWGR enhances GR along two axes: knowledge extraction and fusion. It builds user personalized soft instructions to extract behavior-relevant LLM world knowledge. Then, it formulates knowledge fusion as an optimization problem with explicitly bounded performance degradation, solved via a Lagrangian primal–dual method that selectively incorporates beneficial knowledge. We further design two training strategies for different LLM scales and a deployment scheme that combines nearline precomputation with lightweight online serving. Experiments on multiple public datasets and one industrial dataset show that LWGR outperforms eight state-of-the-art baselines by up to 11.23% and brings a 1.35% revenue lift on a large-scale advertising platform, demonstrating its effectiveness and practicality.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Retrieval Augmented Language Model Pre-TrainingKelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat 等ICML 2020 · 被引用 2,937 次
- Recommender Systems with Generative RetrievalShashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan 等NeurIPS 2023 · 被引用 474 次
- HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural NetworksZhen Dong, Zhewei Yao, Daiyaan Arfeen, Amir Gholami 等NeurIPS 2020 · 被引用 434 次
- Learning Vector-Quantized Item Representation for Transferable Sequential RecommendersYupeng Hou, Zhankui He, Julian J. McAuley, Wayne Xin ZhaoWWW 2023 · 被引用 256 次
相关 Paper
- Beyond Factual Queries: A Novel Predictive Retrieval-Augmented GenerationDebo Cheng, Jianfeng Deng, Qingfeng Chen, Jinyi Jie 等WWW 2026
- Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language ModelsZheng Hu, Zhe Li, Ziyun Jiao, Satoshi Nakagawa 等AAAI 2025 · 被引用 17 次
- GRAM: Generative Recommendation via Semantic-aware Multi-granular Late FusionSunkyung Lee, Minjin Choi, Eunseong Choi, Hye-young Kim 等ACL 2025
- Align³GR: Unified Multi-Level Alignment for LLM-based Generative RecommendationWencai Ye, Mingjie Sun, Shuhang Chen, Wenjin Wu 等AAAI 2026 · 被引用 2 次
- LEARN: Knowledge Adaptation from Large Language Model to Recommendation for Practical Industrial ApplicationJian Jia, Yipei Wang, Yan Li, Honggang Chen 等AAAI 2025 · 被引用 37 次
