Dual Class Knowledge Propagation Network for Multi-label Few-shot Intent Detection
Feng Zhang, Wei Chen, Fei Ding, Tengjiao Wang
Abstract
Multi-label intent detection aims to assign multiple labels to utterances and attracts increasing attention as a practical task in task-oriented dialogue systems. As dialogue domains change rapidly and new intents emerge fast, the lack of annotated data motivates multi-label few-shot intent detection. However, previous studies are confused by the identical representation of the utterance with multiple labels and overlook the intrinsic intra-class and inter-class interactions. To address these two limitations, we propose a novel dual class knowledge propagation network in this paper. In order to learn well-separated representations for utterances with multiple intents, we first introduce a labelsemantic augmentation module incorporating class name information. For better consideration of the inherent intra-class and inter-class relations, an instance-level and a class-level graph neural network are constructed, which not only propagate label information but also propagate feature structure. And we use a simple yet effective method to predict the intent count of each utterance. Extensive experimental results on two multi-label intent datasets have demonstrated that our proposed method outperforms strong baselines by a large margin. * Corresponding author. 𝒙 ! : What day and time did I schedule my test for? 𝒚 ! =request_date, request_time 𝒚 " =request_location 𝒙 " : Where is it located? 𝒙: What time is my meeting and at what location? 𝒚=? 𝑄𝑢𝑒𝑟𝑦 𝐼𝑛𝑠𝑡𝑎𝑛𝑐𝑒 (𝑡𝑒𝑠𝑡 𝑑𝑎𝑡𝑎) 𝑆𝑢𝑝𝑝𝑜𝑟𝑡 𝐸𝑥𝑎𝑚𝑝𝑙𝑒𝑠 (𝑡𝑟𝑎𝑖𝑛𝑖𝑛𝑔 𝑑𝑎𝑡𝑎)
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d420fab1-e197-4715-b088-95df33514fe5Cited by top-tier papers1
Ask how each one uses itBuilds on8
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsKevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. ManningICLR 2020 · 541 citations
- Free Lunch for Few-shot Learning: Distribution CalibrationShuo Yang, Lu Liu, Min XuICLR 2021 · 378 citations
- Few-shot Learning for Multi-label Intent DetectionYutai Hou, Yongkui Lai, Yushan Wu, Wanxiang Che et al.AAAI 2021 · 60 citations
- Order-Free Learning Alleviating Exposure Bias in Multi-Label ClassificationChe-Ping Tsai, Hung-yi LeeAAAI 2020 · 36 citations
- Label-Specific Dual Graph Neural Network for Multi-Label Text ClassificationQianwen Ma, Chunyuan Yuan, Wei Zhou, Songlin HuACL 2021
Related papers
- A Label-Aware BERT Attention Network for Zero-Shot Multi-Intent Detection in Spoken Language UnderstandingTing-Wei Wu, Ruolin Su, Biing-Hwang JuangEMNLP 2021 · 11 citations
- Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrenceMengxiao Song, Bowen Yu, Quangang Li, Yubin Wang et al.EMNLP 2022 · 28 citations
- Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent ClassificationGuangfeng Yan, Lu Fan, Qimai Li, Han Liu et al.ACL 2020 · 69 citations
- GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot FillingLibo Qin, Fuxuan Wei, Tianbao Xie, Xiao Xu et al.ACL 2021
- New Intent Discovery with Pre-training and Contrastive LearningYuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu et al.ACL 2022 · 55 citations
