Lune

EMNLP Findings2025

Flexible Thinking for Multimodal Emotional Support Conversation via Reinforcement Learning

Fanfan Wang, Xiangqing Shen, Jianfei Yu, Rui Xia

摘要

Emotional Support Conversation (ESC) systems aim to alleviate user distress. However, current Chain-of-Thought based ESC methods often employ rigid, text-only reasoning, limiting adaptability in dynamic, multimodal interactions and introducing reasoning noise that degrades support quality. To address this, we introduce "Flexible Thinking" for multimodal ESC, enabling models to adaptively select contextually relevant thinking aspects: Visual Scene, Emotion, Situation, and Response Strategy. We first construct training data by manually curating flexible thinking demonstrations on the MESC dataset, then using a Multimodal Large Language Model to synthesize these processes for the full training set. Then, we propose FIRES, a framework integrating Supervised Fine-Tuning (SFT) for initial learning with Reinforcement Learning for refinement. This two-stage approach helps FIRES transcend SFT's generalization limits and, crucially, directly links thinking processes to response quality via tailored rewards, moving beyond imitating potentially imperfect synthetic data. Experiments on MESC and EMOTyDA datasets demonstrate FIRES's effectiveness and generalizability in fostering higher-quality emotional support responses through adaptive reasoning.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper21

  1. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger 等ICLR 2020 · 8,443 次引用
  2. Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language ModelsWenxuan Huang, Bohan Jia, Shaosheng Cao, Zheyu Ye 等ICLR 2026 · 670 次引用
  3. GPG: A Simple and Strong Reinforcement Learning Baseline for Model ReasoningXiangxiang Chu, Hailang Huang, Xiao Zhang, Fei Wei 等ICLR 2026 · 168 次引用
  4. MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support ConversationQuan Tu, Yanran Li, Jianwei Cui, Bin Wang 等ACL 2022 · 141 次引用
  5. Towards Emotion-aided Multi-modal Dialogue Act ClassificationTulika Saha, Aditya Prakash Patra, Sriparna Saha, Pushpak BhattacharyyaACL 2020 · 63 次引用

相关 Paper

  1. EMO-R3: Reflective Reinforcement Learning for Emotional Reasoning in Multimodal Large Language ModelsYiyang Fang, Wenke Huang, Pei Fu, Yihao Yang 等CVPR 2026 · 4 次引用
  2. ESCA: An Emotional Support Conversation Agent for Enhancing Reasonable Strategy Planning and Effective ExpressionJing Li, Yanxin Luo, Donghong Han, Yimeng Zhan 等AAAI 2026
  3. IntentionESC: An Intention-Centered Framework for Enhancing Emotional Support in Dialogue SystemsXinjie Zhang, Wenxuan Wang, Qin JinACL Findings 2025 · 1 次引用
  4. Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning ApproachJinfeng Zhou, Zhuang Chen, Bo Wang, Minlie HuangACL 2023 · 17 次引用
  5. EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoTBaoqi Pei, Yifei Huang, Jilan Xu, Yuping He 等NeurIPS 2025 · 21 次引用
黄昏的海面,两侧是细线勾勒的悬崖