EMNLP Findings2024
A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent Detection
Xiaotong Zhang, Xinyi Li, Feng Zhang, Zhiyi Wei, Junfeng Liu, Han Liu
Abstract
Few-shot intent detection is a challenging task, particularly in scenarios involving multiple labels and diverse domains. This paper presents a novel prototype learning approach that combines the label synset augmentation and the coarse-to-fine prototype distillation for multilabel few-shot intent detection. To tackle the data scarcity issue and the lack of information for unseen domains, we propose to enhance the representations of utterances with label synset augmentation and refine the prototypes by distilling the coarse domain knowledge from a universal teacher model. To solve the multilingual intent detection in real-world dialogue systems, we fine-tune a cross-lingual teacher model to make our method fast adapt to different languages and re-annotate two non-English task-oriented dialogue datasets CrossWOZ and JMultiWOZ in multi-label form. Experimental results on one English and two non-English datasets demonstrate that our approach significantly outperforms existing methods in terms of accuracy and generalization across different domains.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on19
- Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta et al.AAAI 2020 · 707 citations
- Free Lunch for Few-shot Learning: Distribution CalibrationShuo Yang, Lu Liu, Min XuICLR 2021 · 378 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
- Towards Fine-Grained Transfer: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot FillingLibo Qin, Xiao Xu, Wanxiang Che, Ting LiuEMNLP Findings 2020 · 126 citations
- MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse LanguagesJack FitzGerald, Christopher Hench, Charith Peris, Scott Mackie et al.ACL 2023 · 88 citations
Related papers
- Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot FillingYutai Hou, Yongkui Lai, Cheng Chen, Wanxiang Che et al.ACL Findings 2021 · 16 citations
- Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-trainingHaode Zhang, Haowen Liang, Li-Ming Zhan, Xiao-Ming Wu et al.ACL Findings 2023 · 10 citations
- APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD DetectionPei Wang, Keqing He, Yutao Mou, Xiaoshuai Song et al.EMNLP Findings 2023 · 4 citations
- ProtAugment: Intent Detection Meta-Learning through Unsupervised Diverse ParaphrasingThomas Dopierre, Christophe Gravier, Wilfried LogeraisACL 2021
- Semantic Matching and Aggregation Network for Few-shot Intent DetectionHoang Nguyen, Chenwei Zhang, Congying Xia, Philip S. YuEMNLP Findings 2020 · 24 citations
