EMNLP Findings2023
CoVariance-based Causal Debiasing for Entity and Relation Extraction
Lin Ren, Yongbin Liu, Yixin Cao, Chunping Ouyang
Abstract
Joint entity and relation extraction tasks aim to recognize named entities and extract relations simultaneously. Suffering from a variety of data biases, such as data selection bias, and distribution bias (out of distribution, long-tail distribution), serious concerns can be witnessed to threaten the model's transferability, robustness, and generalization. In this work, we address the above problems from a causality perspective. We propose a novel causal framework called covariance and variance optimization framework (OVO) to optimize feature representations and conduct general debiasing. In particular, the proposed covariance optimizing (COP) minimizes characterizing features' covariance for alleviating the selection and distribution bias and enhances feature representation in the feature space. Furthermore, based on the causal backdoor adjustment, we propose variance optimizing (VOP) separates samples in terms of label information and minimizes the variance of each dimension in the feature vectors of the same class label for mitigating the distribution bias further. By applying it to three strong baselines in two widely used datasets, the results demonstrate the effectiveness and generalization of OVO for joint entity and relation extraction tasks. Furthermore, a fine-grained analysis reveals that OVO possesses the capability to mitigate the impact of long-tail distribution. The code is available at https://github.com/HomuraT/OVO.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Builds on12
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive LearningZihan Lin, Changxin Tian, Yupeng Hou, Wayne Xin ZhaoWWW 2022 · 606 citations
- A Joint Neural Model for Information Extraction with Global FeaturesYing Lin, Heng Ji, Fei Huang, Lingfei WuACL 2020 · 376 citations
- OneRel: Joint Entity and Relation Extraction with One Module in One StepYuming Shang, Heyan Huang, Xianling MaoAAAI 2022 · 200 citations
- Stable Learning via Sample ReweightingZheyan Shen, Peng Cui, Tong Zhang, Kun KuangAAAI 2020 · 155 citations
Related papers
- OODREB: Benchmarking State-of-the-Art Methods for Out-Of-Distribution Generalization on Relation ExtractionHaotian Chen, Houjing Guo, Bingsheng Chen, Xiangdong ZhouWWW 2024 · 1 citation
- Uncovering Main Causalities for Long-tailed Information ExtractionGuoshun Nan, Jiaqi Zeng, Rui Qiao, Zhijiang Guo et al.EMNLP 2021 · 39 citations
- Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation ExtractionRanran Haoran Zhang, Qianying Liu, Aysa Xuemo Fan, Heng Ji et al.EMNLP Findings 2020 · 52 citations
- Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based PropagationYandan Zheng, Anran Hao, Anh Tuan LuuACL 2023 · 5 citations
- Joint Constrained Learning with Boundary-adjusting for Emotion-Cause Pair ExtractionHuawen Feng, Junlong Liu, Junhao Zheng, Haibin Chen et al.ACL 2023 · 9 citations
