De-Bias for Generative Extraction in Unified NER Task
Shuai Zhang, Yongliang Shen, Zeqi Tan, Yiquan Wu, Weiming Lu
Abstract
Named entity recognition (NER) is a fundamental task to recognize specific types of entities from a given sentence. Depending on how the entities appear in the sentence, it can be divided into three subtasks, namely, Flat NER, Nested NER, and Discontinuous NER. Among the existing approaches, only the generative model can be uniformly adapted to these three subtasks. However, when the generative model is applied to NER, its optimization objective is not consistent with the task, which makes the model vulnerable to the incorrect biases. In this paper, we analyze the incorrect biases in the generation process from a causality perspective and attribute them to two confounders: pre-context confounder and entity-order confounder. Furthermore, we design Intra- and Inter-entity Deconfounding Data Augmentation methods to eliminate the above confounders according to the theory of backdoor adjustment. Experiments show that our method can improve the performance of the generative NER model in various datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cc1458d0-ef77-4d83-84ce-251429a6fb8fCited by top-tier papers10
- DiffusionNER: Boundary Diffusion for Named Entity RecognitionYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li et al.ACL 2023 · 70 citations
- PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang et al.ACL 2023 · 46 citations
- Sequence Generation with Label Augmentation for Relation ExtractionBo Li, Dingyao Yu, Wei Ye, Jinglei Zhang et al.AAAI 2023 · 27 citations
- Optimizing Bi-Encoder for Named Entity Recognition via Contrastive LearningSheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung PoonICLR 2023 · 22 citations
- A Generative Model for End-to-End Argument Mining with Reconstructed Positional Encoding and Constrained Pointer MechanismJianzhu Bao, Yuhang He, Yang Sun, Bin Liang et al.EMNLP 2022 · 15 citations
Builds on8
- A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
- LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionIkuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda et al.EMNLP 2020 · 562 citations
- Pyramid: A Layered Model for Nested Named Entity RecognitionJue Wang, Lidan Shou, Ke Chen, Gang ChenACL 2020 · 167 citations
- An Effective Transition-based Model for Discontinuous NERXiang Dai, Sarvnaz Karimi, Ben Hachey, Cécile ParisACL 2020 · 78 citations
- A Trigger-Sense Memory Flow Framework for Joint Entity and Relation ExtractionYongliang Shen, Xinyin Ma, Yechun Tang, Weiming LuWWW 2021 · 72 citations
Related papers
- A Unified Generative Framework for Various NER SubtasksHang Yan, Tao Gui, Junqi Dai, Qipeng Guo et al.ACL 2021
- Debiasing NLU Models via Causal Intervention and Counterfactual ReasoningBing Tian, Yixin Cao, Yong Zhang, Chunxiao XingAAAI 2022 · 45 citations
- SetGNER: General Named Entity Recognition as Entity Set GenerationYuxin He, Buzhou TangEMNLP 2022 · 13 citations
- Locate and Label: A Two-stage Identifier for Nested Named Entity RecognitionYongliang Shen, Xinyin Ma, Zeqi Tan, Shuai Zhang et al.ACL 2021
- Counterfactual Generator: A Weakly-Supervised Method for Named Entity RecognitionXiangji Zeng, Yunliang Li, Yuchen Zhai, Yin ZhangEMNLP 2020 · 55 citations
