Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition
Meihan Tong, Shuai Wang, Bin Xu, Yixin Cao, Minghui Liu, Lei Hou, Juanzi Li
Abstract
Few-shot Named Entity Recognition (NER) exploits only a handful of annotations to identify and classify named entity mentions. Prototypical network shows superior performance on few-shot NER. However, existing prototypical methods fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario. To address the issue, we propose a novel model, Mining Undefined Classes from Other-class (MUCO), that can automatically induce different undefined classes from the other class to improve few-shot NER. With these extra-labeled undefined classes, our method will improve the discriminative ability of NER classifier and enhance the understanding of predefined classes with stand-by semantic knowledge. Experimental results demonstrate that our model outperforms five state-of-the-art models in both 1shot and 5-shots settings on four NER benchmarks. We will release the code upon acceptance. The source code is released on https: //github.com/shuaiwa16/OtherClassNER.git .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f4f67f8d-69bd-4fac-869a-5685692fbd5aCited by top-tier papers9
- Learning In-context Learning for Named Entity RecognitionJiawei Chen, Yaojie Lu, Hongyu Lin, Jie Lou et al.ACL 2023 · 29 citations
- Exploring Modular Task Decomposition in Cross-domain Named Entity RecognitionXinghua Zhang, Bowen Yu, Yubin Wang, Tingwen Liu et al.SIGIR 2022 · 18 citations
- MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity RecognitionJinyuan Fang, Xiaobin Wang, Zaiqiao Meng, Pengjun Xie et al.ACL 2023 · 13 citations
- Learning "O" Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NERRuotian Ma, Xuanting Chen, Zhang Lin, Xin Zhou et al.ACL 2023 · 12 citations
- Channel-Spatial Support-Query Cross-Attention for Fine-Grained Few-Shot Image ClassificationShicheng Yang, Xiaoxu Li, Dongliang Chang, Zhanyu Ma et al.ACM MM 2024 · 12 citations
Builds on2
- Dice Loss for Data-imbalanced NLP TasksXiaoya Li, Xiaofei Sun, Yuxian Meng, Junjun Liang et al.ACL 2020 · 575 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
Related papers
- SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity RecognitionJianing Wang, Chengyu Wang, Chuanqi Tan, Minghui Qiu et al.EMNLP 2022 · 31 citations
- Few-Shot Class-Incremental Learning for Named Entity RecognitionRui Wang, Tong Yu, Handong Zhao, Sungchul Kim et al.ACL 2022 · 26 citations
- Few-shot Named Entity Recognition with Self-describing NetworksJiawei Chen, Qing Liu, Hongyu Lin, Xianpei Han et al.ACL 2022
- Few-Shot Named Entity Recognition: An Empirical Baseline StudyJiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose et al.EMNLP 2021 · 97 citations
- Leveraging Type Descriptions for Zero-shot Named Entity Recognition and ClassificationRami Aly, Andreas Vlachos, Ryan McDonaldACL 2021
