Factorized Latent Reasoning for LLM-based Recommendation
Tianqi Gao, Chengkai Huang, Zihan Wang, Cao Liu, Ke Zeng, Lina Yao
Abstract
Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning approaches typically represent user intent with a single latent vector, which struggles to capture the inherently multi-faceted nature of user preferences. We propose Factorized Latent Reasoning (FLR), a novel framework for LLM-based sequential recommendation that decomposes latent reasoning into multiple disentangled preference factors. FLR introduces a lightweight multi-factor attention module that iteratively refines a latent thought representation, where each factor attends to distinct aspects of the user's interaction history. To encourage diversity and specialization, we design orthogonality, attention diversity, and sparsity regularization objectives, and dynamically aggregate factor contributions for the final prediction. We further integrate FLR with an efficient reinforcement learning strategy based on group-relative policy optimization, enabling stable alignment directly in the latent reasoning space. Experiments on multiple benchmarks show that FLR consistently outperforms strong baselines while improving robustness and interpretability. Our data and code are available at https://github.com/ToAdventure/FLR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 289065ff-f357-4e1c-b5f0-c0fb5240262fBuilds on14
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth ApproachJonas Geiping, Sean McLeish, Neel Jain, John Kirchenbauer et al.NeurIPS 2025 · 431 citations
- Can Small Language Models be Good Reasoners for Sequential Recommendation?Yuling Wang, Changxin Tian, Binbin Hu, Yanhua Yu et al.WWW 2024 · 69 citations
- Reinforced Latent Reasoning for LLM-based RecommendationYang Zhang, Wenxin Xu, Xiaoyan Zhao, Wenjie Wang et al.ICLR 2026 · 67 citations
- OneRec-Think: In-Text Reasoning for Generative RecommendationZhanyu Liu, Shiyao Wang, Xingmei Wang, Rongzhou Zhang et al.ACL 2026 · 48 citations
Related papers
- HyMiRec: A Hybrid Multi-interest Learning Framework for LLM-based Sequential RecommendationJingyi Zhou, Cheng Chen, Kai Zuo, Manjie Xu et al.WWW 2026 · 2 citations
- Intuition-Guided Latent Reasoning for LLM-Based RecommendationChang Liu, Yimeng Bai, Xiaoyan Zhao, Yang Zhang et al.KDD 2026 · 2 citations
- MSR-Rec: Multi-Step Reasoning-Enhanced LLM for Sequential RecommendationTuo Wang, Meng Jian, Ge Shi, Lifang Wu et al.AAAI 2026
- Reinforcement Learning-Constrained Segmented User Modeling with Large Language Models for RecommendationYu Xia, Qing Tan, He Chen, Jingyu Chen et al.WWW 2026
- Think, But Don't Tell: Implicit Reasoning for LLM-based Sequential Recommendation via Multi-Teacher DistillationWeihai Lu, Xiaoxi Cui, Chenke YinSIGIR 2026
