More the Merrier: Towards Multi-Emotion and Intensity Controllable Response Generation
Mauajama Firdaus, Hardik Chauhan, Asif Ekbal, Pushpak Bhattacharyya
Abstract
The focus on conversational systems has recently shifted towards creating engaging agents by embedding emotions into them. Human emotions are highly complex as humans can express multiple emotions with varying intensity in a single utterance, whereas the conversational agents convey only one emotion in their responses. To infuse human-like behaviour in the agents, we introduce the task of multi-emotion controllable response generation with the ability to express different emotions with varying levels of intensity in an open-domain dialogue system. We introduce a Multiple Emotion Intensity aware Multi-party Dialogue (MEIMD) dataset having 34k conversations taken from 8 different TV Series. We propose a Multiple Emotion with Intensity-based Dialogue Generation (MEI-DG) framework. The system employs two novel mechanisms: (i). Explicit Memory: to determine whether to generate an emotion or generic word, while focusing on the intensity of the desired emotions; and (ii). Implicit Memory: to compute the number of words remaining to express the emotion completely, thereby regulating the generation accordingly. The detailed evaluation shows that our proposed approach attains superior performance compared to the baseline models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 22d00fd7-e4b3-42eb-82cf-66a436cc821dCited by top-tier papers1
Ask how each one uses itBuilds on1
Related papers
- EmpMFF: A Multi-factor Sequence Fusion Framework for Empathetic Response GenerationXiaobing Pang, Yequan Wang, Siqi Fan, Lisi Chen et al.WWW 2023 · 13 citations
- Multi-Party Empathetic Dialogue Generation: A New Task for Dialog SystemsLingyu Zhu, Zhengkun Zhang, Jun Wang, Hongbin Wang et al.ACL 2022
- M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue DatabaseJinming Zhao, Tenggan Zhang, Jingwen Hu, Yuchen Liu et al.ACL 2022 · 88 citations
- Towards Emotion-aided Multi-modal Dialogue Act ClassificationTulika Saha, Aditya Prakash Patra, Sriparna Saha, Pushpak BhattacharyyaACL 2020 · 63 citations
- Observe before Generate: Emotion-Cause aware Video Caption for Multimodal Emotion Cause Generation in ConversationsFanfan Wang, Heqing Ma, Xiangqing Shen, Jianfei Yu et al.ACM MM 2024 · 6 citations
