Lune

ACL Findings2021

Frustratingly Simple Few-Shot Slot Tagging

Jianqiang Ma, Zeyu Yan, Chang Li, Yang Zhang

Abstract

We propose a simple and effective few-shot model for slot tagging. Recent work shows that it is promising to extend standard fewshot classification methods to sequence labeling with CRF-specific augmentations. Such methods show strengths in encoding slot name semantics and slot dependencies. However, we find these strengths can be obtained by a much simpler method, which casts slot tagging into machine reading comprehension (MRC). We fine-tune a standard BERT-based MRC model with a mixture of source domain and (few-shot) target domain data. Such simple method outperforms state-of-the-art methods by a large margin on the SNIPS dataset.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. MISE: Meta-knowledge Inheritance for Social Media-Based Stressor EstimationXin Wang, Ling Feng, Huijun Zhang, Lei Cao et al.WWW 2025 · 2 citations

Builds on4

  1. A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
  2. Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
  3. CorefQA: Coreference Resolution as Query-based Span PredictionWei Wu, Fei Wang, Arianna Yuan, Fei Wu et al.ACL 2020 · 153 citations
  4. Bridging Anaphora Resolution as Question AnsweringYufang HouACL 2020 · 43 citations

Related papers

  1. Augmented Natural Language for Generative Sequence LabelingBen Athiwaratkun, Cícero Nogueira dos Santos, Jason Krone, Bing XiangEMNLP 2020 · 54 citations
  2. Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical ScenariosYufan Wang, Jie Mei, Bowei Zou, Rui Fan et al.ACL Findings 2023 · 4 citations
  3. Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot FillingJie Han, Yixiong Zou, Haozhao Wang, Jun Wang et al.AAAI 2024 · 4 citations
  4. Inverse is Better! Fast and Accurate Prompt for Few-shot Slot TaggingYutai Hou, Cheng Chen, Xianzhen Luo, Bohan Li et al.ACL Findings 2022 · 24 citations
  5. A Domain-Transfer Meta Task Design Paradigm for Few-Shot Slot TaggingFengyi Yang, Xi Zhou, Yating Yang, Bo Ma et al.AAAI 2023
Dusk over the sea between two cliffs drawn in fine vertical lines