Robust Few-Shot Named Entity Recognition with Boundary Discrimination and Correlation Purification
Xiaojun Xue, Chunxia Zhang, Tianxiang Xu, Zhendong Niu
Abstract
Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean without noise or outliers, and there are few works focusing on the robustness of the cross-domain transfer learning ability to textual adversarial attacks in Few-shot NER. In this work, we comprehensively explore and assess the robustness of few-shot NER models under textual adversarial attack scenario, and found the vulnerability of existing few-shot NER models. Furthermore, we propose a robust two-stage few-shot NER method with Boundary Discrimination and Correlation Purification (BDCP). Specifically, in the span detection stage, the entity boundary discriminative module is introduced to provide a highly distinguishing boundary representation space to detect entity spans. In the entity typing stage, the correlations between entities and contexts are purified by minimizing the interference information and facilitating correlation generalization to alleviate the perturbations caused by textual adversarial attacks. In addition, we construct adversarial examples for few-shot NER based on public datasets Few-NERD and Cross-Dataset. Comprehensive evaluations on those two groups of few-shot NER datasets containing adversarial examples demonstrate the robustness and superiority of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ddb63d4-3bbf-4e7e-b24d-a990e615fafbCited by top-tier papers2
- MISE: Meta-knowledge Inheritance for Social Media-Based Stressor EstimationXin Wang, Ling Feng, Huijun Zhang, Lei Cao et al.WWW 2025 · 2 citations
- Adversity-aware Few-shot Named Entity Recognition via Augmentation LearningLi Huang, Haowen Liu, Qiang Gao, Jiajing Yu et al.AAAI 2025 · 1 citation
Builds on14
- BERT-ATTACK: Adversarial Attack Against BERT Using BERTLinyang Li, Ruotian Ma, Qipeng Guo, Xiangyang Xue et al.EMNLP 2020 · 529 citations
- FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingChen Zhu, Yu Cheng, Zhe Gan, Siqi Sun et al.ICLR 2020 · 502 citations
- Learning Robust Representations via Multi-View Information BottleneckMarco Federici, Anjan Dutta, Patrick Forré, Nate Kushman et al.ICLR 2020 · 330 citations
- Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor LearningYi Yang, Arzoo KatiyarEMNLP 2020 · 198 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
Related papers
- SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity RecognitionJianing Wang, Chengyu Wang, Chuanqi Tan, Minghui Qiu et al.EMNLP 2022 · 31 citations
- Few-shot Named Entity Recognition with Self-describing NetworksJiawei Chen, Qing Liu, Hongyu Lin, Xianpei Han et al.ACL 2022
- CONTaiNER: Few-Shot Named Entity Recognition via Contrastive LearningSarkar Snigdha Sarathi Das, Arzoo Katiyar, Rebecca J. Passonneau, Rui ZhangACL 2022
- Exploring Modular Task Decomposition in Cross-domain Named Entity RecognitionXinghua Zhang, Bowen Yu, Yubin Wang, Tingwen Liu et al.SIGIR 2022 · 18 citations
- Few-NERD: A Few-shot Named Entity Recognition DatasetNing Ding, Guangwei Xu, Yulin Chen, Xiaobin Wang et al.ACL 2021
