EMNLP Findings2023
SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations
Yirong Chen, Xiaofen Xing, Jingkai Lin, Huimin Zheng, Zhenyu Wang, Qi Liu, Xiangmin Xu
Abstract
Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling, they often rush to provide universal advice. However, when users seek psychological support, they need to gain empathy, trust, understanding and comfort, rather than just reasonable advice. To this end, we constructed a multi-turn empathetic conversation dataset of more than 2 million samples, in which the input is the multi-turn conversation context, and the target is empathetic responses that cover expressions such as questioning, comfort, recognition, listening, trust, emotional support, etc. Experiments have shown that the empathy ability of LLMs can be significantly enhanced when finetuning by using multi-turn dialogue history and responses that are closer to the expression of a psychological consultant. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 25 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers25
- PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological CounselingHaojie Xie, Yirong Chen, Xiaofen Xing, Jingkai Lin et al.ACL 2025 · 43 citations
- RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic AgentsPeisong Wang, Ruotian Ma, Bang Zhang, Xingyu Chen et al.ICLR 2026 · 28 citations
- Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and ReasoningChongyuan Dai, Jinpeng Hu, Hongchang Shi, Zhuo Li et al.ACL 2026 · 18 citations
- PsyDial: A Large-scale Long-term Conversational Dataset for Mental Health SupportHuachuan Qiu, Zhenzhong LanACL 2025 · 13 citations
- KokoroChat: A Japanese Psychological Counseling Dialogue Dataset Collected via Role-Playing by Trained CounselorsZhiyang Qi, Takumasa Kaneko, Keiko Takamizo, Mariko Ukiyo et al.ACL 2025 · 7 citations
Builds on9
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang et al.ICLR 2023 · 295 citations
- MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support ConversationQuan Tu, Yanran Li, Jianwei Cui, Bin Wang et al.ACL 2022 · 141 citations
- PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health SupportHao Sun, Zhenru Lin, Chujie Zheng, Siyang Liu et al.ACL Findings 2021 · 69 citations
Related papers
- CogEmp: A Cognitive Empathy-Oriented Dialogue System for Structured Psychological CounselingYiguo Deng, Xia Lei, Yuan Zhang, Long YeACL Findings 2026
- CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological CounselingChenhao Zhang, Renhao Li, Minghuan Tan, Min Yang et al.ACL Findings 2024 · 38 citations
- Preference Learning Unlocks LLMs' Psycho-Counseling SkillsMian Zhang, Shaun M. Eack, Zhiyu ChenACL Findings 2026
- Therapy as an NLP Task: Comparing LLMs and Human Peers Behaviors in CBT SessionsZainab Iftikhar, Sean Ransom, Amy Wei Xiao, Nicole Nugent et al.CSCW 2026
- Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral TheorySuyeon Lee, Sunghwan Kim, Minju Kim, Dongjin Kang et al.EMNLP Findings 2024 · 14 citations
