ACL Findings2022
Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin
Abstract
Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed metalearning approach which addresses the problem of few-shot NER by sequentially tackling fewshot span detection and few-shot entity typing using meta-learning. In particular, we take the few-shot span detection as a sequence labeling problem and train the span detector by introducing the model-agnostic meta-learning (MAML) algorithm to find a good model parameter initialization that could fast adapt to new entity classes. For few-shot entity typing, we propose MAML-ProtoNet, i.e., MAML-enhanced prototypical networks to find a good embedding space that can better distinguish text span representations from different entity classes. Extensive experiments on various benchmarks show that our approach achieves superior performance over prior methods. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 11 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers11
- SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity RecognitionJianing Wang, Chengyu Wang, Chuanqi Tan, Minghui Qiu et al.EMNLP 2022 · 31 citations
- Learning In-context Learning for Named Entity RecognitionJiawei Chen, Yaojie Lu, Hongyu Lin, Jie Lou et al.ACL 2023 · 29 citations
- MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity RecognitionJinyuan Fang, Xiaobin Wang, Zaiqiao Meng, Pengjun Xie et al.ACL 2023 · 13 citations
- ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity RecognitionLing Ge, Chunming Hu, Guanghui Ma, Hong Zhang et al.AAAI 2023 · 9 citations
- Robust Few-Shot Named Entity Recognition with Boundary Discrimination and Correlation PurificationXiaojun Xue, Chunxia Zhang, Tianxiang Xu, Zhendong NiuAAAI 2024 · 7 citations
Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesEleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin et al.ICLR 2020 · 692 citations
- A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
- Template-Based Named Entity Recognition Using BARTLeyang Cui, Yu Wu, Jian Liu, Sen Yang et al.ACL Findings 2021 · 342 citations
- Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor LearningYi Yang, Arzoo KatiyarEMNLP 2020 · 198 citations
Related papers
- Type-Aware Decomposed Framework for Few-Shot Named Entity RecognitionYongqi Li, Yu Yu, Tieyun QianEMNLP Findings 2023 · 32 citations
- Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity RecognitionZihan Wang, Kewen Zhao, Zilong Wang, Jingbo ShangEMNLP Findings 2022 · 7 citations
- Task-adaptive Label Dependency Transfer for Few-shot Named Entity RecognitionShan Zhang, Bin Cao, Tianming Zhang, Yuqi Liu et al.ACL Findings 2023 · 5 citations
- Few-Shot Named Entity Recognition: An Empirical Baseline StudyJiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose et al.EMNLP 2021 · 97 citations
- Learning from Miscellaneous Other-Class Words for Few-shot Named Entity RecognitionMeihan Tong, Shuai Wang, Bin Xu, Yixin Cao et al.ACL 2021
