Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversations
Jihyoung Jang, Minseong Boo, Hyounghun Kim
Abstract
In the field of natural language processing, open-domain chatbots have emerged as an important research topic. However, a major limitation of existing open-domain chatbot research is its singular focus on short single-session dialogue, neglecting the potential need for understanding contextual information in multiple consecutive sessions that precede an ongoing dialogue. Among the elements that compose the context in multi-session conversation settings, the time intervals between sessions and the relationships between speakers would be particularly important. Despite their importance, current research efforts have not sufficiently addressed these dialogical components. In this paper, we introduce a new 1M multi-session dialogue dataset, called Conversation Chronicles, for implementing a long-term conversation setup in which time intervals and fine-grained speaker relationships are incorporated. Following recent works, we exploit a large language model to produce the data. The extensive human evaluation shows that dialogue episodes in Conversation Chronicles reflect those properties while maintaining coherent and consistent interactions across all the sessions. We also propose a dialogue model, called ReBot, which consists of chronological summarization and dialogue generation modules using only around 630M parameters. When trained on Conversation Chronicles, ReBot demonstrates long-term context understanding with a high human engagement score.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
13 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Beyond Goldfish Memory: Long-Term Open-Domain Conversation cites BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
- MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents cites Beyond Goldfish Memory: Long-Term Open-Domain Conversation
- MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents cites Evaluating Very Long-Term Conversational Memory of LLM Agents
- From Tools to Teammates: Evaluating LLMs in Multi-Session Coding Interactions cites Evaluating Very Long-Term Conversational Memory of LLM Agents
- Evaluating Very Long-Term Conversational Memory of LLM Agents cites Beyond Goldfish Memory: Long-Term Open-Domain Conversation
- Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
- Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning cites Beyond Goldfish Memory: Long-Term Open-Domain Conversation
- Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning cites Evaluating Very Long-Term Conversational Memory of LLM Agents
- A-Mem: Agentic Memory for LLM Agents cites Beyond Goldfish Memory: Long-Term Open-Domain Conversation
- A-Mem: Agentic Memory for LLM Agents cites Evaluating Very Long-Term Conversational Memory of LLM Agents
Cited by top-tier papers13
- A-Mem: Agentic Memory for LLM AgentsWujiang Xu, Zujie Liang, Kai Mei, Hang Gao et al.NeurIPS 2025 · 1,138 citations
- Evaluating Very Long-Term Conversational Memory of LLM AgentsAdyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal et al.ACL 2024 · 30 citations
- Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit ReasoningXintong Li, Jalend Bantupalli, Ria Dharmani, Yuwei Zhang et al.EMNLP 2025 · 12 citations
- From Tools to Teammates: Evaluating LLMs in Multi-Session Coding InteractionsNathanaël Carraz Rakotonirina, Mohammed Hamdy, Jon Ander Campos, Lucas Weber et al.ACL 2025 · 5 citations
- MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM AgentsYiming Du, Bingbing Wang, Yang He, Bin Liang et al.AAAI 2026 · 2 citations
Builds on9
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Beyond Goldfish Memory: Long-Term Open-Domain ConversationJing Xu, Arthur Szlam, Jason WestonACL 2022 · 329 citations
- Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat DataCanwen Xu, Daya Guo, Nan Duan, Julian J. McAuleyEMNLP 2023 · 112 citations
Related papers
- Mind the Gap Between Conversations for Improved Long-Term Dialogue GenerationQiang Zhang, Jason Naradowsky, Yusuke MiyaoEMNLP Findings 2023 · 4 citations
- Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face ConversationSe Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim et al.ACL 2024
- LLM-REDIAL: A Large-Scale Dataset for Conversational Recommender Systems Created from User Behaviors with LLMsTingting Liang, Chenxin Jin, Lingzhi Wang, Wenqi Fan et al.ACL Findings 2024 · 18 citations
- History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue SystemTong Zhang, Yong Liu, Boyang Li, Zhiwei Zeng et al.EMNLP Findings 2022 · 14 citations
- Enabling Chatbots with Eyes and Ears: An Immersive Multimodal Conversation System for Dynamic InteractionsJihyoung Jang, Minwook Bae, Minji Kim, Dilek Hakkani-Tür et al.ACL 2025
