Knowing False Negatives: An Adversarial Training Method for Distantly Supervised Relation Extraction
Kailong Hao, Botao Yu, Wei Hu
Abstract
Distantly supervised relation extraction (RE) automatically aligns unstructured text with relation instances in a knowledge base (KB). Due to the incompleteness of current KBs, sentences implying certain relations may be annotated as N/A instances, which causes the socalled false negative (FN) problem. Current RE methods usually overlook this problem, inducing improper biases in both training and testing procedures. To address this issue, we propose a two-stage approach. First, it finds out possible FN samples by heuristically leveraging the memory mechanism of deep neural networks. Then, it aligns those unlabeled data with the training data into a unified feature space by adversarial training to assign pseudo labels and further utilize the information contained in them. Experiments on two wildlyused benchmark datasets demonstrate the effectiveness of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Revisiting DocRED - Addressing the False Negative Problem in Relation ExtractionQingyu Tan, Lu Xu, Lidong Bing, Hwee Tou Ng et al.EMNLP 2022 · 76 citations
- Competition or Cooperation? Exploring Unlabeled Data via Challenging Minimax Game for Semi-supervised Relation ExtractionYu Hong, Jiahang Li, Jianchuan Feng, Chenghua Huang et al.AAAI 2023 · 4 citations
Builds on4
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
- SELF: Learning to Filter Noisy Labels with Self-EnsemblingDuc Tam Nguyen, Chaithanya Kumar Mummadi, Thi-Phuong-Nhung Ngo, Thi Hoai Phuong Nguyen et al.ICLR 2020 · 354 citations
- NERO: A Neural Rule Grounding Framework for Label-Efficient Relation ExtractionWenxuan Zhou, Hongtao Lin, Bill Yuchen Lin, Ziqi Wang et al.WWW 2020 · 57 citations
- Joint Entity and Relation Extraction with a Hybrid Transformer and Reinforcement Learning Based ModelYa Xiao, Chengxiang Tan, Zhijie Fan, Qian Xu et al.AAAI 2020 · 33 citations
Related papers
- Revisiting the Negative Data of Distantly Supervised Relation ExtractionChenhao Xie, Jiaqing Liang, Jingping Liu, Chengsong Huang et al.ACL 2021
- Improving Neural Relation Extraction with Implicit Mutual RelationsJun Kuang, Yixin Cao, Jianbing Zheng, Xiangnan He et al.ICDE 2020 · 24 citations
- S2ynRE: Two-stage Self-training with Synthetic data for Low-resource Relation ExtractionBenfeng Xu, Quan Wang, Yajuan Lyu, Dai Dai et al.ACL 2023 · 13 citations
- Fine-grained Entity Typing without Knowledge BaseJing Qian, Yibin Liu, Lemao Liu, Yangming Li et al.EMNLP 2021 · 1 citation
- Are Noisy Sentences Useless for Distant Supervised Relation Extraction?Yuming Shang, He Yan Huang, Xianling Mao, Xin Sun et al.AAAI 2020 · 39 citations
