EMNLP Findings2021
An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling
Han Liu, Feng Zhang, Xiaotong Zhang, Siyang Zhao, Xianchao Zhang
Abstract
Intent classification (IC) and slot filling (SF) are critical building blocks in task-oriented dialogue systems. These two tasks are closelyrelated and can flourish each other. Since only a few utterances can be utilized for identifying fast-emerging new intents and slots, data scarcity issue often occurs when implementing IC and SF. However, few IC/SF models perform well when the number of training samples per class is quite small. In this paper, we propose a novel explicit-joint and supervisedcontrastive learning framework for few-shot intent classification and slot filling. Its highlights are as follows. (i) The model extracts intent and slot representations via bidirectional interactions, and extends prototypical network to achieve explicit-joint learning, which guarantees that IC and SF tasks can mutually reinforce each other. (ii) The model integrates with supervised contrastive learning, which ensures that samples from same class are pulled together and samples from different classes are pushed apart. In addition, the model follows a not common but practical way to construct the episode, which gets rid of the traditional setting with fixed way and shot, and allows for unbalanced datasets. Extensive experiments on three public datasets show that our model can achieve promising performance.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 2 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers2
- Boosting Few-Shot Text Classification via Distribution EstimationHan Liu, Feng Zhang, Xiaotong Zhang, Siyang Zhao et al.AAAI 2023 · 19 citations
- Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot FillingJie Han, Yixiong Zou, Haozhao Wang, Jun Wang et al.AAAI 2024 · 4 citations
Builds on10
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- PANet: Few-Shot Image Semantic Segmentation With Prototype AlignmentKaixin Wang, Jun Hao Liew, Yingtian Zou, Daquan Zhou et al.ICCV 2019 · 1,404 citations
- Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesEleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin et al.ICLR 2020 · 692 citations
- Few-Shot Unsupervised Image-to-Image TranslationMing-Yu Liu, Xun Huang, Arun Mallya, Tero Karras et al.ICCV 2019 · 668 citations
Related papers
- Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot FillingYutai Hou, Yongkui Lai, Cheng Chen, Wanxiang Che et al.ACL Findings 2021 · 16 citations
- HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot FillingJunwen Zhang, Yin ZhangEMNLP Findings 2023 · 5 citations
- IntenDD: A Unified Contrastive Learning Approach for Intent Detection and DiscoveryBhavuk Singhal, Ashim Gupta, Shivasankaran V. P, Amrith KrishnaEMNLP Findings 2023 · 3 citations
- Transfer-Free Data-Efficient Multilingual Slot LabelingEvgeniia Razumovskaia, Ivan Vulic, Anna KorhonenEMNLP 2023 · 1 citation
- Towards Multi-Intent Spoken Language Understanding via Hierarchical Attention and Optimal TransportXuxin Cheng, Zhihong Zhu, Hongxiang Li, Yaowei Li et al.AAAI 2024 · 19 citations
