Universal Item Tokenization for Transferable Generative Recommendation
Bowen Zheng, Hongyu Lu, Yu Chen, Wayne Xin Zhao, Ji-Rong Wen
Abstract
Recently, generative recommendation has emerged as a promising paradigm, attracting significant research attention. The basic framework involves an item tokenizer, which represents each item as a sequence of codes serving as its identifier, and a generative recommender that predicts the next item by autoregressively generating the target item identifier. However, in existing methods, both the tokenizer and the recommender are typically domain-specific, limiting their ability for effective transfer or adaptation to new domains. To this end, we propose UTGRec, a Universal item Tokenization approach for transferable Generative Recommendation. Specifically, we design a universal item tokenizer for encoding rich item semantics by adapting a multimodal large language model (MLLM). By devising tree-structured codebooks, we discretize content representations into corresponding codes for item tokenization. To effectively learn the universal item tokenizer on multiple domains, we introduce two key techniques in our approach. For raw content reconstruction, we employ dual lightweight decoders to reconstruct item text and images from discrete representations to capture general knowledge embedded in the content. For collaborative knowledge integration, we assume that co-occurring items are similar and integrate collaborative signals through co-occurrence alignment and reconstruction. Finally, we present a joint learning framework to pre-train and adapt the transferable generative recommender across multiple domains. Extensive experiments on four public datasets demonstrate the superiority of UTGRec compared
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3bc7772-7965-4503-9591-af5048243a3dCited by top-tier papers6
- Diffusion Generative Recommendation with Continuous TokensHaohao Qu, Shanru Lin, Yujuan Ding, Yiqi Wang et al.WWW 2026 · 5 citations
- Generating Long Semantic IDs in Parallel for RecommendationYupeng Hou, Jiacheng Li, Ashley Shin, Jinsung Jeon et al.KDD 2025 · 4 citations
- GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow NetworksYejing Wang, Shengyu Zhou, Jinyu Lu, Qidong Liu et al.SIGIR 2026 · 1 citation
- CARD: Non-Uniform Quantization of Visual Semantic Unit for Generative RecommendationYibiao Wei, Jie Zou, Pengfei Zhang, Xiao Ao et al.SIGIR 2026 · 1 citation
- LLM-Aligned Geographic Item Tokenization for Local-Life RecommendationHao Jiang, Guoquan Wang, Donglin Zhou, Sheng Yu et al.AAAI 2026
Builds on24
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Autoregressive Image Generation without Vector QuantizationTianhong Li, Yonglong Tian, He Li, Mingyang Deng et al.NeurIPS 2024 · 758 citations
- Contrastive Learning for Sequential RecommendationXu Xie, Fei Sun, Zhaoyang Liu, Shiwen Wu et al.ICDE 2022 · 674 citations
- Transformer Memory as a Differentiable Search IndexYi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni et al.NeurIPS 2022 · 506 citations
Related papers
- Tokenize Once, Recommend Anywhere: Unified Item Tokenization for Multi-domain LLM-based RecommendationYu Hou, Won-Yong ShinAAAI 2026
- Generative Recommender with End-to-End Learnable Item TokenizationEnze Liu, Bowen Zheng, Cheng Ling, Lantao Hu et al.SIGIR 2025 · 11 citations
- From IDs to Semantics: A Generative Framework for Cross-Domain Recommendation with Adaptive Semantic TokenizationPeiyu Hu, Wayne Lu, Jia WangAAAI 2026 · 5 citations
- Multimodal Quantitative Language for Generative RecommendationJianyang Zhai, Zi-Feng Mai, Chang-Dong Wang, Feidiao Yang et al.ICLR 2025
- Order-agnostic Identifier for Large Language Model-based Generative RecommendationXinyu Lin, Haihan Shi, Wenjie Wang, Fuli Feng et al.SIGIR 2025 · 15 citations
