One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profiles
Zhengyi Ma, Zhicheng Dou, Yutao Zhu, Hanxun Zhong, Ji-Rong Wen
Abstract
Personalized chatbots focus on endowing chatbots with a consistent personality to behave like real users, give more informative responses, and further act as personal assistants. Existing personalized approaches tried to incorporate several text descriptions as explicit user profiles. However, the acquisition of such explicit profiles is expensive and time-consuming, thus being impractical for large-scale real-world applications. Moreover, the restricted predefined profile neglects the language behavior of a real user and cannot be automatically updated together with the change of user interests. In this paper, we propose to learn implicit user profiles automatically from large-scale user dialogue history for building personalized chatbots. Specifically, leveraging the benefits of Transformer on language understanding, we train a personalized language model to construct a general user profile from the user's historical responses. To highlight the relevant historical responses to the input post, we further establish a key-value memory network of historical post-response pairs, and build a dynamic post-aware user profile. The dynamic profile mainly describes what and how the user has responded to similar posts in history. To explicitly utilize users' frequently used words, we design a personalized decoder to fuse two decoding strategies, including generating a word from the generic vocabulary and copying one word from the user's personalized vocabulary. Experiments on two real-world datasets show the significant improvement of our model compared with existing methods. Our code is available at https://github.com/zhengyima/DHAP
• Computing methodologies → Discourse, dialogue and pragmatics; Natural language generation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 46dad010-4e99-4e8d-ab32-a03d8f2c3c6aCited by top-tier papers13
- Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older AdultsYucheng Jin, Wanling Cai, Li Chen, Yizhe Zhang et al.CHI 2024 · 63 citations
- Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningZhaoxuan Tan, Qingkai Zeng, Yijun Tian, Zheyuan Liu et al.EMNLP 2024 · 17 citations
- Target-aware Abstractive Related Work Generation with Contrastive LearningXiuying Chen, Hind Alamro, Mingzhe Li, Shen Gao et al.SIGIR 2022 · 16 citations
- RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response GenerationShuai Liu, Hyundong Cho, Marjorie Freedman, Xuezhe Ma et al.ACL 2023 · 15 citations
- Personalized Pieces: Efficient Personalized Large Language Models through Collaborative EffortsZhaoxuan Tan, Zheyuan Liu, Meng JiangEMNLP 2024 · 11 citations
Builds on5
- You Impress Me: Dialogue Generation via Mutual Persona PerceptionQian Liu, Yihong Chen, Bei Chen, Jian-Guang Lou et al.ACL 2020 · 144 citations
- Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue GenerationHaoyu Song, Yan Wang, Weinan Zhang, Xiaojiang Liu et al.ACL 2020 · 86 citations
- Generating Persona Consistent Dialogues by Exploiting Natural Language InferenceHaoyu Song, Wei-Nan Zhang, Jingwen Hu, Ting LiuAAAI 2020 · 85 citations
- Encoding History with Context-aware Representation Learning for Personalized SearchYujia Zhou, Zhicheng Dou, Ji-Rong WenSIGIR 2020 · 56 citations
- ScriptWriter: Narrative-Guided Script GenerationYutao Zhu, Ruihua Song, Zhicheng Dou, Jian-Yun Nie et al.ACL 2020 · 23 citations
Related papers
- "In-Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue LearningChuanqi Cheng, Quan Tu, Wei Wu, Shuo Shang et al.EMNLP 2024 · 3 citations
- A Pre-Training Based Personalized Dialogue Generation Model with Persona-Sparse DataYinhe Zheng, Rongsheng Zhang, Minlie Huang, Xiaoxi MaoAAAI 2020 · 173 citations
- Doing Personal LAPS: LLM-Augmented Dialogue Construction for Personalized Multi-Session Conversational SearchHideaki Joko, Shubham Chatterjee, Andrew Ramsay, Arjen P. de Vries et al.SIGIR 2024 · 24 citations
- Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized AlignmentWeixiang Zhao, Xingyu Sui, Yulin Hu, Jiahe Guo et al.NeurIPS 2025 · 34 citations
- Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense PersonaYihong Tang, Bo Wang, Miao Fang, Dongming Zhao et al.ACL 2023 · 9 citations
