Lune

EMNLP Findings2023

CoVariance-based Causal Debiasing for Entity and Relation Extraction

Lin Ren, Yongbin Liu, Yixin Cao, Chunping Ouyang

Abstract

Joint entity and relation extraction tasks aim to recognize named entities and extract relations simultaneously. Suffering from a variety of data biases, such as data selection bias, and distribution bias (out of distribution, long-tail distribution), serious concerns can be witnessed to threaten the model's transferability, robustness, and generalization. In this work, we address the above problems from a causality perspective. We propose a novel causal framework called covariance and variance optimization framework (OVO) to optimize feature representations and conduct general debiasing. In particular, the proposed covariance optimizing (COP) minimizes characterizing features' covariance for alleviating the selection and distribution bias and enhances feature representation in the feature space. Furthermore, based on the causal backdoor adjustment, we propose variance optimizing (VOP) separates samples in terms of label information and minimizes the variance of each dimension in the feature vectors of the same class label for mitigating the distribution bias further. By applying it to three strong baselines in two widely used datasets, the results demonstrate the effectiveness and generalization of OVO for joint entity and relation extraction tasks. Furthermore, a fine-grained analysis reveals that OVO possesses the capability to mitigate the impact of long-tail distribution. The code is available at https://github.com/HomuraT/OVO.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Causality Meets the Table: Debiasing LLMs for Faithful TableQA via Front-Door InterventionZhen Yang, Ziwei Du, Minghan Zhang, Wei Du et al.NeurIPS 2025 · 6 citations

Builds on12

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive LearningZihan Lin, Changxin Tian, Yupeng Hou, Wayne Xin ZhaoWWW 2022 · 606 citations
  3. A Joint Neural Model for Information Extraction with Global FeaturesYing Lin, Heng Ji, Fei Huang, Lingfei WuACL 2020 · 376 citations
  4. OneRel: Joint Entity and Relation Extraction with One Module in One StepYuming Shang, Heyan Huang, Xianling MaoAAAI 2022 · 200 citations
  5. Stable Learning via Sample ReweightingZheyan Shen, Peng Cui, Tong Zhang, Kun KuangAAAI 2020 · 155 citations

Related papers

  1. OODREB: Benchmarking State-of-the-Art Methods for Out-Of-Distribution Generalization on Relation ExtractionHaotian Chen, Houjing Guo, Bingsheng Chen, Xiangdong ZhouWWW 2024 · 1 citation
  2. Uncovering Main Causalities for Long-tailed Information ExtractionGuoshun Nan, Jiaqi Zeng, Rui Qiao, Zhijiang Guo et al.EMNLP 2021 · 39 citations
  3. Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation ExtractionRanran Haoran Zhang, Qianying Liu, Aysa Xuemo Fan, Heng Ji et al.EMNLP Findings 2020 · 52 citations
  4. Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based PropagationYandan Zheng, Anran Hao, Anh Tuan LuuACL 2023 · 5 citations
  5. Joint Constrained Learning with Boundary-adjusting for Emotion-Cause Pair ExtractionHuawen Feng, Junlong Liu, Junhao Zheng, Haibin Chen et al.ACL 2023 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines