Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification
Guangfeng Yan, Lu Fan, Qimai Li, Han Liu, Xiaotong Zhang, Xiao-Ming Wu, Albert Y. S. Lam
Abstract
User intent classification plays a vital role in dialogue systems. Since user intent may frequently change over time in many realistic scenarios, unknown (new) intent detection has become an essential problem, where the study has just begun. This paper proposes a semantic-enhanced Gaussian mixture model (SEG) for unknown intent detection. In particular, we model utterance embeddings with a Gaussian mixture distribution and inject dynamic class semantic information into Gaussian means, which enables learning more classconcentrated embeddings that help to facilitate downstream outlier detection. Coupled with a density-based outlier detection algorithm, SEG achieves competitive results on three real task-oriented dialogue datasets in two languages for unknown intent detection. On top of that, we propose to integrate SEG as an unknown intent identifier into existing generalized zero-shot intent classification models to improve their performance. A case study on a state-of-the-art method, ReCapsNet, shows that SEG can push the classification performance to a significantly higher level.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ae00cfac-d064-4e5e-91a5-b3d754a1b3b0Cited by top-tier papers15
- Deep Open Intent Classification with Adaptive Decision BoundaryHanlei Zhang, Hua Xu, Ting-En LinAAAI 2021 · 127 citations
- KNN-Contrastive Learning for Out-of-Domain Intent ClassificationYunhua Zhou, Peiju Liu, Xipeng QiuACL 2022 · 86 citations
- MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in ConversationsHanlei Zhang, Xin Wang, Hua Xu, Qianrui Zhou et al.ICLR 2024 · 29 citations
- Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category DetectionHan Liu, Feng Zhang, Xiaotong Zhang, Siyang Zhao et al.KDD 2022 · 23 citations
- Learn to Adapt for Generalized Zero-Shot Text ClassificationYiwen Zhang, Caixia Yuan, Xiaojie Wang, Ziwei Bai et al.ACL 2022 · 21 citations
Related papers
- Linguistically-Enriched and Context-AwareZero-shot Slot FillingA. B. Siddique, Fuad T. Jamour, Vagelis HristidisWWW 2021 · 29 citations
- Emu: Enhancing Multilingual Sentence Embeddings with Semantic SpecializationWataru Hirota, Yoshihiko Suhara, Behzad Golshan, Wang-Chiew TanAAAI 2020 · 5 citations
- Dual Class Knowledge Propagation Network for Multi-label Few-shot Intent DetectionFeng Zhang, Wei Chen, Fei Ding, Tengjiao WangACL 2023 · 5 citations
- New Intent Discovery with Pre-training and Contrastive LearningYuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu et al.ACL 2022 · 55 citations
- Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot FillingBowen Xing, Ivor W. TsangEMNLP 2022 · 24 citations
