Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach
Jinfeng Zhou, Zhuang Chen, Bo Wang, Minlie Huang
Abstract
Emotional support conversation (ESC) aims to provide emotional support (ES) to improve one's mental state. Existing works stay at fitting grounded responses and responding strategies (e.g., question), which ignore the effect on ES and lack explicit goals to guide emotional positive transition. To this end, we introduce a new paradigm to formalize multi-turn ESC as a process of positive emotion elicitation. Addressing this task requires finely adjusting the elicitation intensity in ES as the conversation progresses while maintaining conversational goals like coherence. In this paper, we propose Supporter, a mixture-of-expert-based reinforcement learning model, and well design ES and dialogue coherence rewards to guide policy's learning for responding. Experiments verify the superiority of Supporter in achieving positive emotion elicitation during responding while maintaining conversational goals including coherence.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- Cooper: Coordinating Specialized Agents towards a Complex Dialogue GoalYi Cheng, Wenge Liu, Jian Wang, Chak Tou Leong et al.AAAI 2024 · 34 citations
- Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support ConversationZhe Xu, Daoyuan Chen, Jiayi Kuang, Zihao Yi et al.SIGIR 2024 · 9 citations
- SEER: Facilitating Structured Reasoning and Explanation via Reinforcement LearningGuoxin Chen, Kexin Tang, Chao Yang, Fuying Ye et al.ACL 2024 · 5 citations
- Be Helpful but Don't Talk too Much - Enhancing Helpfulness in Conversations through Relevance in Multi-Turn Emotional SupportJunlin Li, Bo Peng, Yu-Yin Hsu, Chu-Ren HuangEMNLP 2024 · 2 citations
- ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional SupportTiantian Chen, Jiaqi Lu, Ying Shen, Lin ZhangWWW 2026 · 1 citation
Builds on8
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- CEM: Commonsense-Aware Empathetic Response GenerationSahand Sabour, Chujie Zheng, Minlie HuangAAAI 2022 · 196 citations
- MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support ConversationQuan Tu, Yanran Li, Jianwei Cui, Bin Wang et al.ACL 2022 · 141 citations
- Knowledge Bridging for Empathetic Dialogue GenerationQintong Li, Piji Li, Zhaochun Ren, Pengjie Ren et al.AAAI 2022 · 128 citations
- Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy PlanningYi Cheng, Wenge Liu, Wenjie Li, Jiashuo Wang et al.EMNLP 2022 · 32 citations
Related papers
- ESCA: An Emotional Support Conversation Agent for Enhancing Reasonable Strategy Planning and Effective ExpressionJing Li, Yanxin Luo, Donghong Han, Yimeng Zhan et al.AAAI 2026
- Dialogue Systems for Emotional Support via Value ReinforcementJuhee Kim, Chunghu Mok, Jisun Lee, Hyang Sook Kim et al.ACL 2025
- ESCoT: Towards Interpretable Emotional Support Dialogue SystemsTenggan Zhang, Xinjie Zhang, Jinming Zhao, Li Zhou et al.ACL 2024
- Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support ConversationDongjin Kang, Sunghwan Kim, Taeyoon Kwon, Seungjun Moon et al.ACL 2024 · 14 citations
- MultiAgentESC: A LLM-based Multi-Agent Collaboration Framework for Emotional Support ConversationYangyang Xu, Jinpeng Hu, Zhuoer Zhao, Zhangling Duan et al.EMNLP 2025 · 3 citations
