EMNLP Findings2023
PCMID: Multi-Intent Detection through Supervised Prototypical Contrastive Learning
Yurun Song, Junchen Zhao, Spencer Koehler, Amir Abdullah, Ian G. Harris
摘要
Intent detection is a major task in Natural Language Understanding (NLU) and is the core component of dialogue systems for interpreting users' intentions based on their utterances. Many works have explored detecting intents by assuming that each utterance represents only a single intent. Such systems have achieved very good results; however, intent detection is a far more challenging task in typical real-world scenarios, where each user utterance can be highly complex and express multiple intents. Therefore, in this paper, we propose PCMID, a novel Multi-Intent Detection framework enabled by Prototypical Contrastive Learning under a supervised setting. The PCMID model can learn multiple semantic representations of a given user utterance under the context of different intent labels in an optimized semantic space. Our experiments show that PCMID achieves the current state-of-the-art performance on both multiple public benchmark datasets and a private real-world dataset for the multi-intent detection task.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper13
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna 等NeurIPS 2020 · 7,049 次引用
- Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta 等AAAI 2020 · 707 次引用
- Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningBeliz Gunel, Jingfei Du, Alexis Conneau, Veselin StoyanovICLR 2021 · 595 次引用
- Prototypical Contrastive Learning of Unsupervised RepresentationsJunnan Li, Pan Zhou, Caiming Xiong, Steven C. H. HoiICLR 2021 · 484 次引用
- COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary 等NeurIPS 2021 · 231 次引用
相关 Paper
- Towards Multi-Intent Spoken Language Understanding via Hierarchical Attention and Optimal TransportXuxin Cheng, Zhihong Zhu, Hongxiang Li, Yaowei Li 等AAAI 2024 · 19 次引用
- Multi-Label Intent Detection via Contrastive Task Specialization of Sentence EncodersIvan Vulic, Iñigo Casanueva, Georgios Spithourakis, Avishek Mondal 等EMNLP 2022 · 6 次引用
- A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class IntentsAnkan Mullick, Sombit Bose, Abhilash Nandy, Gajula Chaitanya 等EMNLP Findings 2024 · 2 次引用
- IntenDD: A Unified Contrastive Learning Approach for Intent Detection and DiscoveryBhavuk Singhal, Ashim Gupta, Shivasankaran V. P, Amrith KrishnaEMNLP Findings 2023 · 3 次引用
- Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent DiscoveryYimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu 等EMNLP Findings 2024 · 2 次引用
