Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona
Yihong Tang, Bo Wang, Miao Fang, Dongming Zhao, Kun Huang, Ruifang He, Yuexian Hou
Abstract
The personalized dialogue explores the consistent relationship between dialogue generation and personality. Existing personalized dialogue agents model persona profiles from three resources: sparse or dense persona descriptions and dialogue histories. However, sparse structured persona attributes are explicit but uninformative, dense persona texts contain rich persona descriptions with much noise, and dialogue history query is both noisy and uninformative for persona modeling. In this work, we combine the advantages of the three resources to obtain a richer and more accurate persona. We design a Contrastive Latent Variable-based model (CLV) that clusters the dense persona descriptions into sparse categories, which are combined with the history query to generate personalized responses. Experimental results on Chinese and English datasets demonstrate our model's superiority in personalization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4d0b253b-8f8a-49a4-a312-3ec4a2c021c4Cited by top-tier papers8
- Can Large Language Models Be Good Companions?: An LLM-Based Eyewear System with Conversational Common GroundZhenyu Xu, Hailin Xu, Zhouyang Lu, Yingying Zhao et al.UbiComp 2024 · 20 citations
- Thinking in Character: Advancing Role-Playing Agents with Role-Aware ReasoningYihong Tang, Kehai Chen, Muyun Yang, Zheng-Yu Niu et al.NeurIPS 2025 · 16 citations
- Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and AnalysisJisoo Mok, Ik-hwan Kim, Sangkwon Park, Sungroh YoonACL 2025 · 10 citations
- "In-Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue LearningChuanqi Cheng, Quan Tu, Wei Wu, Shuo Shang et al.EMNLP 2024 · 3 citations
- Enhancing Persona Following at Decoding Time via Dynamic Importance Estimation for Role-Playing AgentsYuxin Liu, Mingye Zhu, Siyuan Liu, Bo Hu et al.ICLR 2026 · 2 citations
Builds on9
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- PLATO: Pre-trained Dialogue Generation Model with Discrete Latent VariableSiqi Bao, Huang He, Fan Wang, Hua Wu et al.ACL 2020 · 229 citations
- A Pre-Training Based Personalized Dialogue Generation Model with Persona-Sparse DataYinhe Zheng, Rongsheng Zhang, Minlie Huang, Xiaoxi MaoAAAI 2020 · 173 citations
- You Impress Me: Dialogue Generation via Mutual Persona PerceptionQian Liu, Yihong Chen, Bei Chen, Jian-Guang Lou et al.ACL 2020 · 144 citations
- One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User ProfilesZhengyi Ma, Zhicheng Dou, Yutao Zhu, Hanxun Zhong et al.SIGIR 2021 · 67 citations
Related papers
- Learning to Know Myself: A Coarse-to-Fine Persona-Aware Training Framework for Personalized Dialogue GenerationYunpeng Li, Yue Hu, Yajing Sun, Luxi Xing et al.AAAI 2023 · 9 citations
- PAED: Zero-Shot Persona Attribute Extraction in DialoguesLuyao Zhu, Wei Li, Rui Mao, Vlad Pandelea et al.ACL 2023 · 30 citations
- MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent SpaceYihong Tang, Bo Wang, Dongming Zhao, Xiaojia Jin et al.EMNLP 2024 · 1 citation
- Learning Retrieval Augmentation for Personalized Dialogue GenerationQiushi Huang, Shuai Fu, Xubo Liu, Wenwu Wang et al.EMNLP 2023 · 13 citations
- MPCHAT: Towards Multimodal Persona-Grounded ConversationJaewoo Ahn, Yeda Song, Sangdoo Yun, Gunhee KimACL 2023 · 4 citations
