Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Abstract
Instead of simply matching a query to preexisting passages, generative retrieval generates identifier strings of passages as the retrieval target. At a cost, the identifier must be distinctive enough to represent a passage. Current approaches use either a numeric ID or a text piece (such as a title or substrings) as the identifier. However, these identifiers cannot cover a passage's content well. As such, we are motivated to propose a new type of identifier, synthetic identifiers, that are generated based on the content of a passage and could integrate contextualized information that text pieces lack. Furthermore, we simultaneously consider multiview identifiers, including synthetic identifiers, titles, and substrings. These views of identifiers complement each other and facilitate the holistic ranking of passages from multiple perspectives. We conduct a series of experiments on three public datasets, and the results indicate that our proposed approach performs the best in generative retrieval, demonstrating its effectiveness and robustness. The code is released at https://github.com/liyongqi67/MINDER .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0842cffb-cc67-4afb-926e-1bc51f73f5faCited by top-tier papers33
- Learning to Rank in Generative RetrievalYongqi Li, Nan Yang, Liang Wang, Furu Wei et al.AAAI 2024 · 83 citations
- Scalable and Effective Generative Information RetrievalHansi Zeng, Chen Luo, Bowen Jin, Sheikh Muhammad Sarwar et al.WWW 2024 · 72 citations
- Semantic Gesticulator: Semantics-Aware Co-Speech Gesture SynthesisZeyi Zhang, Tenglong Ao, Yuyao Zhang, Qingzhe Gao et al.SIGGRAPH 2024 · 39 citations
- Generative Multi-Modal Knowledge Retrieval with Large Language ModelsXinwei Long, Jiali Zeng, Fandong Meng, Zhiyuan Ma et al.AAAI 2024 · 35 citations
- Bridging Items and Language: A Transition Paradigm for Large Language Model-Based RecommendationXinyu Lin, Wenjie Wang, Yongqi Li, Fuli Feng et al.KDD 2024 · 27 citations
Builds on10
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Transformer Memory as a Differentiable Search IndexYi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni et al.NeurIPS 2022 · 506 citations
- Pre-training Tasks for Embedding-based Large-scale RetrievalWei-Cheng Chang, Felix X. Yu, Yin-Wen Chang, Yiming Yang et al.ICLR 2020 · 325 citations
- Autoregressive Search Engines: Generating Substrings as Document IdentifiersMichele Bevilacqua, Giuseppe Ottaviano, Patrick Lewis, Scott Yih et al.NeurIPS 2022 · 242 citations
- A Neural Corpus Indexer for Document RetrievalYujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao et al.NeurIPS 2022 · 242 citations
Related papers
- Multi-level Relevance Document Identifier Learning for Generative RetrievalFuwei Zhang, Xiaoyu Liu, Xinyu Jia, Yingfei Zhang et al.ACL 2025 · 5 citations
- Generative Retrieval via Term Set GenerationPeitian Zhang, Zheng Liu, Yujia Zhou, Zhicheng Dou et al.SIGIR 2024 · 13 citations
- Descriptive and Discriminative Document Identifiers for Generative RetrievalJiehan Cheng, Zhicheng Dou, Yutao Zhu, Xiaoxi LiAAAI 2025 · 4 citations
- GLEN: Generative Retrieval via Lexical Index LearningSunkyung Lee, Minjin Choi, Jongwuk LeeEMNLP 2023 · 6 citations
- Generative Retrieval Meets Multi-Graded RelevanceYubao Tang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke et al.NeurIPS 2024 · 18 citations
