Lune

ACL Findings2021

Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling

Yutai Hou, Yongkui Lai, Cheng Chen, Wanxiang Che, Ting Liu

Abstract

In this paper, we investigate few-shot joint learning for dialogue language understanding. Most existing few-shot models learn a single task each time with only a few examples. However, dialogue language understanding contains two closely related tasks, i.e., intent detection and slot filling, and often benefits from jointly learning the two tasks. This calls for new few-shot learning techniques that are able to capture task relations from only a few examples and jointly learn multiple tasks. To achieve this, we propose a similarity-based few-shot learning scheme, named Contrastive Prototype Merging network (ConProm), that learns to bridge metric spaces of intent and slot on data-rich domains, and then adapt the bridged metric space to specific few-shot domain. Experiments on two public datasets, Snips and FewJoint, show that our model significantly outperforms the strong baselines in one and five shots settings.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot FillingJie Han, Yixiong Zou, Haozhao Wang, Jun Wang et al.AAAI 2024 · 4 citations

Builds on5

  1. Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
  2. Few-shot Text Classification with Distributional SignaturesYujia Bao, Menghua Wu, Shiyu Chang, Regina BarzilayICLR 2020 · 183 citations
  3. Towards Fine-Grained Transfer: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot FillingLibo Qin, Xiao Xu, Wanxiang Che, Ting LiuEMNLP Findings 2020 · 126 citations
  4. Neural Snowball for Few-Shot Relation LearningTianyu Gao, Xu Han, Ruobing Xie, Zhiyuan Liu et al.AAAI 2020 · 85 citations
  5. Few-shot Learning for Multi-label Intent DetectionYutai Hou, Yongkui Lai, Yushan Wu, Wanxiang Che et al.AAAI 2021 · 60 citations

Related papers

  1. An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot FillingHan Liu, Feng Zhang, Xiaotong Zhang, Siyang Zhao et al.EMNLP Findings 2021 · 20 citations
  2. Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical ScenariosYufan Wang, Jie Mei, Bowei Zou, Rui Fan et al.ACL Findings 2023 · 4 citations
  3. A Domain-Transfer Meta Task Design Paradigm for Few-Shot Slot TaggingFengyi Yang, Xi Zhou, Yating Yang, Bo Ma et al.AAAI 2023
  4. A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent DetectionXiaotong Zhang, Xinyi Li, Feng Zhang, Zhiyi Wei et al.EMNLP Findings 2024 · 3 citations
  5. DSPM-NLG: A Dual Supervised Pre-trained Model for Few-shot Natural Language Generation in Task-oriented Dialogue SystemYufan Wang, Bowei Zou, Rui Fan, Ai Ti Aw et al.ACL Findings 2023 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines