EMNLP Findings2024
Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery
Yimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu, Xueming Qian
Abstract
New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stages. They either handle the two processes in a pipeline manner, which exhibits a gap between intent representation and clustering process or use typical contrastive clustering that overlooks the potential supervised signals from the whole data. Besides, they often individually deal with open intent discovery or OOD settings. To this end, we propose a Pseudo-Label enhanced Prototypical Contrastive Learning (PLPCL) model for uniformed intent discovery. We iteratively utilize pseudo-labels to explore potential positive/negative samples for contrastive learning and bridge the gap between representation and clustering. To enable better knowledge transfer, we design a prototype learning method integrating the supervised and pseudo signals from IND and OOD samples. In addition, our method has been proven effective in two different settings of discovering new intents. Experiments on three benchmark datasets and two task settings demonstrate the effectiveness of our approach. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on13
- Contrastive ClusteringYunfan Li, Peng Hu, Jerry Zitao Liu, Dezhong Peng et al.AAAI 2021 · 798 citations
- Learning to Discover Novel Visual Categories via Deep Transfer ClusteringKai Han, Andrea Vedaldi, Andrew ZissermanICCV 2019 · 378 citations
- Unsupervised Semantic Segmentation by Distilling Feature CorrespondencesMark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely et al.ICLR 2022 · 317 citations
- Discovering New Intents via Constrained Deep Adaptive Clustering with Cluster RefinementTing-En Lin, Hua Xu, Hanlei ZhangAAAI 2020 · 127 citations
- Generalized Category Discovery with Decoupled Prototypical NetworkWenbin An, Feng Tian, Qinghua Zheng, Wei Ding et al.AAAI 2023 · 68 citations
Related papers
- Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent DiscoveryYutao Mou, Xiaoshuai Song, Keqing He, Chen Zeng et al.ACL 2023 · 5 citations
- Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent DiscoveryYutao Mou, Keqing He, Pei Wang, Yanan Wu et al.EMNLP 2022 · 9 citations
- New Intent Discovery with Pre-training and Contrastive LearningYuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu et al.ACL 2022 · 55 citations
- ClusterPrompt: Cluster Semantic Enhanced Prompt Learning for New Intent DiscoveryJinggui Liang, Lizi LiaoEMNLP Findings 2023 · 6 citations
- IntenDD: A Unified Contrastive Learning Approach for Intent Detection and DiscoveryBhavuk Singhal, Ashim Gupta, Shivasankaran V. P, Amrith KrishnaEMNLP Findings 2023 · 3 citations
