Generative Recommender with End-to-End Learnable Item Tokenization
Enze Liu, Bowen Zheng, Cheng Ling, Lantao Hu, Han Li, Wayne Xin Zhao
Abstract
Generative recommender systems have gained increasing attention as an innovative approach that directly generates item identifiers for recommendation tasks. Despite their potential, a major challenge is the effective construction of item identifiers that align well with recommender systems. Current approaches often treat item tokenization and generative recommendation training as separate processes, which can lead to suboptimal performance. To overcome this issue, we introduce ETEGRec, a novel End-To-End Generative Recommender that unifies item tokenization and generative recommendation into a cohesive framework. Built on a dual encoder-decoder architecture, ETEGRec consists of an item tokenizer and a generative recommender. To enable synergistic interaction between these components, we propose a recommendation-oriented alignment strategy, which includes two key optimization objectives: sequence-item alignment and preference-semantic alignment. These objectives tightly couple the learning processes of the item tokenizer and the generative recommender, fostering mutual enhancement. Additionally, we develop an alternating optimization technique to ensure stable and efficient end-to-end training of the entire framework. Extensive experiments demonstrate the superior performance of our approach compared to traditional sequential recommendation models and existing generative recommendation baselines. Our code is available at https://github.com/RUCAIBox/ETEGRec.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 33551f86-dfaa-41d2-a990-c48593182e3dCited by top-tier papers13
- Generating Long Semantic IDs in Parallel for RecommendationYupeng Hou, Jiacheng Li, Ashley Shin, Jinsung Jeon et al.KDD 2025 · 4 citations
- APAO: Bridging the Training-Inference Gap in Generative Recommendation via Adaptive Prefix-Aware OptimizationYuanqing Yu, Yifan Wang, Weizhi Ma, Zhiqiang Guo et al.KDD 2026 · 4 citations
- GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow NetworksYejing Wang, Shengyu Zhou, Jinyu Lu, Qidong Liu et al.SIGIR 2026 · 1 citation
- Token-level Collaborative Alignment for LLM-based Generative RecommendationFake Lin, Binbin Hu, Zhi Zheng, Xi Zhu et al.WWW 2026 · 1 citation
- Collaborative Memory Augmentation for Generative RecommendationEnze Liu, Zhen Tian, Wayne Xin ZhaoKDD 2026 · 1 citation
Builds on8
- Recommender Systems with Generative RetrievalShashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan et al.NeurIPS 2023 · 474 citations
- Sequential Recommendation with Graph Neural NetworksJianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui et al.SIGIR 2021 · 435 citations
- Filter-enhanced MLP is All You Need for Sequential RecommendationKun Zhou, Hui Yu, Wayne Xin Zhao, Ji-Rong WenWWW 2022 · 411 citations
- Learning to Tokenize for Generative RetrievalWeiwei Sun, Lingyong Yan, Zheng Chen, Shuaiqiang Wang et al.NeurIPS 2023 · 151 citations
- Decoupled Side Information Fusion for Sequential RecommendationYueqi Xie, Peilin Zhou, Sunghun KimSIGIR 2022 · 144 citations
Related papers
- Universal Item Tokenization for Transferable Generative RecommendationBowen Zheng, Hongyu Lu, Yu Chen, Wayne Xin Zhao et al.SIGIR 2026
- Bi-Level Optimization for Generative Recommendation: Bridging Tokenization and GenerationYimeng Bai, Chang Liu, Yang Zhang, Dingxian Wang et al.SIGIR 2026
- Learning Decomposed Contextual Token Representations from Pretrained and Collaborative Signals for Generative RecommendationYifan Liu, Yaokun Liu, Zelin Li, Zhenrui Yue et al.SIGIR 2026
- Order-agnostic Identifier for Large Language Model-based Generative RecommendationXinyu Lin, Haihan Shi, Wenjie Wang, Fuli Feng et al.SIGIR 2025 · 15 citations
- IDGenRec: LLM-RecSys Alignment with Textual ID LearningJuntao Tan, Shuyuan Xu, Wenyue Hua, Yingqiang Ge et al.SIGIR 2024 · 45 citations
