Lune

EMNLP Findings2024

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery

Yimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu, Xueming Qian

摘要

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stages. They either handle the two processes in a pipeline manner, which exhibits a gap between intent representation and clustering process or use typical contrastive clustering that overlooks the potential supervised signals from the whole data. Besides, they often individually deal with open intent discovery or OOD settings. To this end, we propose a Pseudo-Label enhanced Prototypical Contrastive Learning (PLPCL) model for uniformed intent discovery. We iteratively utilize pseudo-labels to explore potential positive/negative samples for contrastive learning and bridge the gap between representation and clustering. To enable better knowledge transfer, we design a prototype learning method integrating the supervised and pseudo signals from IND and OOD samples. In addition, our method has been proven effective in two different settings of discovering new intents. Experiments on three benchmark datasets and two task settings demonstrate the effectiveness of our approach. 1

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper13

  1. Contrastive ClusteringYunfan Li, Peng Hu, Jerry Zitao Liu, Dezhong Peng 等AAAI 2021 · 798 次引用
  2. Learning to Discover Novel Visual Categories via Deep Transfer ClusteringKai Han, Andrea Vedaldi, Andrew ZissermanICCV 2019 · 378 次引用
  3. Unsupervised Semantic Segmentation by Distilling Feature CorrespondencesMark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely 等ICLR 2022 · 317 次引用
  4. Discovering New Intents via Constrained Deep Adaptive Clustering with Cluster RefinementTing-En Lin, Hua Xu, Hanlei ZhangAAAI 2020 · 127 次引用
  5. Generalized Category Discovery with Decoupled Prototypical NetworkWenbin An, Feng Tian, Qinghua Zheng, Wei Ding 等AAAI 2023 · 68 次引用

相关 Paper

  1. Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent DiscoveryYutao Mou, Xiaoshuai Song, Keqing He, Chen Zeng 等ACL 2023 · 5 次引用
  2. Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent DiscoveryYutao Mou, Keqing He, Pei Wang, Yanan Wu 等EMNLP 2022 · 9 次引用
  3. New Intent Discovery with Pre-training and Contrastive LearningYuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu 等ACL 2022 · 55 次引用
  4. ClusterPrompt: Cluster Semantic Enhanced Prompt Learning for New Intent DiscoveryJinggui Liang, Lizi LiaoEMNLP Findings 2023 · 6 次引用
  5. IntenDD: A Unified Contrastive Learning Approach for Intent Detection and DiscoveryBhavuk Singhal, Ashim Gupta, Shivasankaran V. P, Amrith KrishnaEMNLP Findings 2023 · 3 次引用
黄昏的海面,两侧是细线勾勒的悬崖