ACL Findings2021
Frustratingly Simple Few-Shot Slot Tagging
Jianqiang Ma, Zeyu Yan, Chang Li, Yang Zhang
Abstract
We propose a simple and effective few-shot model for slot tagging. Recent work shows that it is promising to extend standard fewshot classification methods to sequence labeling with CRF-specific augmentations. Such methods show strengths in encoding slot name semantics and slot dependencies. However, we find these strengths can be obtained by a much simpler method, which casts slot tagging into machine reading comprehension (MRC). We fine-tune a standard BERT-based MRC model with a mixture of source domain and (few-shot) target domain data. Such simple method outperforms state-of-the-art methods by a large margin on the SNIPS dataset.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on4
- A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
- CorefQA: Coreference Resolution as Query-based Span PredictionWei Wu, Fei Wang, Arianna Yuan, Fei Wu et al.ACL 2020 · 153 citations
- Bridging Anaphora Resolution as Question AnsweringYufang HouACL 2020 · 43 citations
Related papers
- Augmented Natural Language for Generative Sequence LabelingBen Athiwaratkun, Cícero Nogueira dos Santos, Jason Krone, Bing XiangEMNLP 2020 · 54 citations
- Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical ScenariosYufan Wang, Jie Mei, Bowei Zou, Rui Fan et al.ACL Findings 2023 · 4 citations
- Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot FillingJie Han, Yixiong Zou, Haozhao Wang, Jun Wang et al.AAAI 2024 · 4 citations
- Inverse is Better! Fast and Accurate Prompt for Few-shot Slot TaggingYutai Hou, Cheng Chen, Xianzhen Luo, Bohan Li et al.ACL Findings 2022 · 24 citations
- A Domain-Transfer Meta Task Design Paradigm for Few-Shot Slot TaggingFengyi Yang, Xi Zhou, Yating Yang, Bo Ma et al.AAAI 2023
