S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation
Zihao Guo, Jian Wang, Ruxin Zhou, Youhua Liu, Jiawei Guo, Jun Zhao, Xiaoxiao Xu, Yongqi Liu, Kaiqiao Zhan
Abstract
Generative Recommendation (GR) has emerged as a transformative paradigm with its end-to-end generation advantages. However, existing GR methods primarily focus on direct semantic ID (SID) generation from interaction sequences, failing to activate deeper reasoning capabilities analogous to those in large language models and thus limiting performance potential. We identify two critical limitations in current reasoning-enhanced GR approaches:
(1) Strict sequential separation between reasoning and generation steps creates imbalanced computational focus across hierarchical SID codes, degrading quality for SID codes; (2) Generated reasoning vectors lack interpretable semantics, while reasoning paths suffer from unverifiable supervision. In this paper, we propose stepwise semantic-guided reasoning in latent space (S 2 GR), a novel reasoning enhanced GR framework. First, we establish a robust semantic foundation via codebook optimization, integrating item co-occurrence relationship to capture behavioral patterns, and load balancing and uniformity objectives that maximize codebook utilization while reinforcing coarse-to-fine semantic hierarchies. Our core innovation introduces the stepwise reasoning mechanism inserting thinking tokens before each SID generation step, where each token explicitly represents coarse-grained semantics supervised via contrastive learning against ground-truth codebook cluster distributions ensuring physically grounded reasoning paths and balanced computational focus across all SID codes. Extensive experiments demonstrate the superiority of S 2 GR, and online A/B test confirms efficacy on large-scale industrial short video platform.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 773e43ff-fe01-459f-8600-a91aa6d5267cCited by top-tier papers1
Ask how each one uses itBuilds on8
- Recommender Systems with Generative RetrievalShashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan et al.NeurIPS 2023 · 474 citations
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsDamai Dai, Chengqi Deng, Chenggang Zhao, R. X. Xu et al.ACL 2024 · 171 citations
- On Softmax Direct Preference Optimization for RecommendationYuxin Chen, Junfei Tan, An Zhang, Zhengyi Yang et al.NeurIPS 2024 · 126 citations
- Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense RepresentationsYuhao Yang, Zhi Ji, Zhaopeng Li, Yi Li et al.NeurIPS 2025 · 90 citations
- Latent Visual ReasoningBangzheng Li, Ximeng Sun, Jiang Liu, Ze Wang et al.ICLR 2026 · 80 citations
Related papers
- Reasoning over Semantic IDs Enhances Generative RecommendationYingzhi He, Yan Sun, Junfei Tan, Yuxin Chen et al.KDD 2026 · 15 citations
- Cross-Scale Collaboration between LLMs and Lightweight Sequential Recommenders with Domain-Specific Latent ReasoningYipeng Zhang, Xin Wang, Hong Chen, Junwei Pan et al.AAAI 2026
- MSR-Rec: Multi-Step Reasoning-Enhanced LLM for Sequential RecommendationTuo Wang, Meng Jian, Ge Shi, Lifang Wu et al.AAAI 2026
- Efficient Post-Training Refinement of Latent Reasoning in Large Language ModelsXinyuan Wang, Dongjie Wang, Wangyang Ying, Haoyue Bai et al.AAAI 2026 · 6 citations
- Unifying Behavior Modeling and Semantic Generation for Generative RecommendationBinquan Wu, Xinbo Chen, Yicheng Luo, Yuhao Ke et al.KDD 2026
