EMNLP Findings2023
PCMID: Multi-Intent Detection through Supervised Prototypical Contrastive Learning
Yurun Song, Junchen Zhao, Spencer Koehler, Amir Abdullah, Ian G. Harris
Abstract
Intent detection is a major task in Natural Language Understanding (NLU) and is the core component of dialogue systems for interpreting users' intentions based on their utterances. Many works have explored detecting intents by assuming that each utterance represents only a single intent. Such systems have achieved very good results; however, intent detection is a far more challenging task in typical real-world scenarios, where each user utterance can be highly complex and express multiple intents. Therefore, in this paper, we propose PCMID, a novel Multi-Intent Detection framework enabled by Prototypical Contrastive Learning under a supervised setting. The PCMID model can learn multiple semantic representations of a given user utterance under the context of different intent labels in an optimized semantic space. Our experiments show that PCMID achieves the current state-of-the-art performance on both multiple public benchmark datasets and a private real-world dataset for the multi-intent detection task.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on13
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta et al.AAAI 2020 · 707 citations
- Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningBeliz Gunel, Jingfei Du, Alexis Conneau, Veselin StoyanovICLR 2021 · 595 citations
- Prototypical Contrastive Learning of Unsupervised RepresentationsJunnan Li, Pan Zhou, Caiming Xiong, Steven C. H. HoiICLR 2021 · 484 citations
- COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary et al.NeurIPS 2021 · 231 citations
Related papers
- Towards Multi-Intent Spoken Language Understanding via Hierarchical Attention and Optimal TransportXuxin Cheng, Zhihong Zhu, Hongxiang Li, Yaowei Li et al.AAAI 2024 · 19 citations
- Multi-Label Intent Detection via Contrastive Task Specialization of Sentence EncodersIvan Vulic, Iñigo Casanueva, Georgios Spithourakis, Avishek Mondal et al.EMNLP 2022 · 6 citations
- A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class IntentsAnkan Mullick, Sombit Bose, Abhilash Nandy, Gajula Chaitanya et al.EMNLP Findings 2024 · 2 citations
- IntenDD: A Unified Contrastive Learning Approach for Intent Detection and DiscoveryBhavuk Singhal, Ashim Gupta, Shivasankaran V. P, Amrith KrishnaEMNLP Findings 2023 · 3 citations
- Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent DiscoveryYimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu et al.EMNLP Findings 2024 · 2 citations
