Beyond Single Emotion: Multi-label Approach to Conversational Emotion Recognition
Yujin Kang, Yoon-Sik Cho
Abstract
Emotion recognition in conversation (ERC) has been promoted with diverse approaches in the recent years. However, many studies have pointed out that emotion shift and confusing labels make it difficult for models to distinguish between different emotions. Existing ERC models suffer from these problems when the emotions are forced to be mapped into single label. In this paper, we utilize our strategies for extending single label to multi-labels. We then propose a multi-label classification framework for emotion recognition in conversation (ML-ERC). Specifically, we introduce weighted supervised contrastive learning tailored for multi-label, which can easily applied to previous ERC models. The empirical results on existing task with single label support the efficacy of our approach, which is more effective in the most challenging settings: emotion shift or confusing labels. We also evaluate ML-ERC with the multi-labels we produced to support our contrastive learning scheme.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c1745b5b-90e6-467f-b400-c5f2c7ab5615Cited by top-tier papers1
Ask how each one uses itBuilds on12
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningBeliz Gunel, Jingfei Du, Alexis Conneau, Veselin StoyanovICLR 2021 · 595 citations
- Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in ConversationsTaichi Ishiwatari, Yuki Yasuda, Taro Miyazaki, Jun GotoEMNLP 2020 · 201 citations
- M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue DatabaseJinming Zhao, Tenggan Zhang, Jingwen Hu, Yuchen Liu et al.ACL 2022 · 88 citations
- Supervised Prototypical Contrastive Learning for Emotion Recognition in ConversationXiaohui Song, Longtao Huang, Hui Xue, Songlin HuEMNLP 2022 · 84 citations
Related papers
- MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in ConversationsTao Shi, Shao-Lun HuangACL 2023 · 76 citations
- Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in ConversationShihao Zou, Xianying Huang, Xudong ShenACM MM 2023 · 24 citations
- Hybrid Curriculum Learning for Emotion Recognition in ConversationLin Yang, Yi Shen, Yue Mao, Longjun CaiAAAI 2022 · 64 citations
- Supervised Adversarial Contrastive Learning for Emotion Recognition in ConversationsDou Hu, Yinan Bao, Lingwei Wei, Wei Zhou et al.ACL 2023 · 64 citations
- Ada2I: Enhancing Modality Balance for Multimodal Conversational Emotion RecognitionCam-Van Thi Nguyen, The-Son Le, Anh-Tuan Mai, Duc-Trong LeACM MM 2024 · 13 citations
