Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery
Yutao Mou, Xiaoshuai Song, Keqing He, Chen Zeng, Pei Wang, Jingang Wang, Yunsen Xian, Weiran Xu
Abstract
Generalized intent discovery aims to extend a closed-set in-domain intent classifier to an open-world intent set including in-domain and out-of-domain intents. The key challenges lie in pseudo label disambiguation and representation learning. Previous methods suffer from a coupling of pseudo label disambiguation and representation learning, that is, the reliability of pseudo labels relies on representation learning, and representation learning is restricted by pseudo labels in turn. In this paper, we propose a decoupled prototype learning framework (DPL) to decouple pseudo label disambiguation and representation learning. Specifically, we firstly introduce prototypical contrastive representation learning (PCL) to get discriminative representations. And then we adopt a prototypebased label disambiguation method (PLD) to obtain pseudo labels. We theoretically prove that PCL and PLD work in a collaborative fashion and facilitate pseudo label disambiguation. Experiments and analysis on three benchmark datasets show the effectiveness of our method. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2d369603-66f7-4894-8f2a-19e0bed8081fCited by top-tier papers4
- A Survey of Ontology Expansion for Conversational UnderstandingJinggui Liang, Yuxia Wu, Yuan Fang, Hao Fei et al.EMNLP 2024 · 3 citations
- Learning Geometry-Aware Representations for New Intent DiscoveryKai Tang, Junbo Zhao, Xiao Ding, Runze Wu et al.ACL 2024
- Unsupervised Semantic Discovery via Global and Local Semantic Alignment in Multimodal ClusteringZhengzhong Zhu, Pei Zhou, Weihong Du, Shiquan Min et al.AAAI 2026
- Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal UtterancesHanlei Zhang, Hua Xu, Fei Long, Xin Wang et al.ACL 2024
Builds on9
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Self-labelling via simultaneous clustering and representation learningYuki Markus Asano, Christian Rupprecht, Andrea VedaldiICLR 2020 · 873 citations
- Prototypical Contrastive Learning of Unsupervised RepresentationsJunnan Li, Pan Zhou, Caiming Xiong, Steven C. H. HoiICLR 2021 · 484 citations
- A Unified Objective for Novel Class DiscoveryEnrico Fini, Enver Sangineto, Stéphane Lathuilière, Zhun Zhong et al.ICCV 2021 · 248 citations
- PiCO: Contrastive Label Disambiguation for Partial Label LearningHaobo Wang, Ruixuan Xiao, Yixuan Li, Lei Feng et al.ICLR 2022 · 169 citations
Related papers
- Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent DiscoveryYutao Mou, Keqing He, Pei Wang, Yanan Wu et al.EMNLP 2022 · 9 citations
- New Intent Discovery with Pre-training and Contrastive LearningYuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu et al.ACL 2022 · 55 citations
- Generalized Category Discovery with Decoupled Prototypical NetworkWenbin An, Feng Tian, Qinghua Zheng, Wei Ding et al.AAAI 2023 · 68 citations
- Dynamic Conceptional Contrastive Learning for Generalized Category DiscoveryNan Pu, Zhun Zhong, Nicu SebeCVPR 2023
- Discovering New Intents with Deep Aligned ClusteringHanlei Zhang, Hua Xu, Ting-En Lin, Rui LyuAAAI 2021 · 138 citations
