A Positive-Unlabeled Metric Learning Framework for Document-Level Relation Extraction with Incomplete Labeling
Ye Wang, Huazheng Pan, Tao Zhang, Wen Wu, Wenxin Hu
Abstract
The goal of document-level relation extraction (RE) is to identify relations between entities that span multiple sentences. Recently, incomplete labeling in document-level RE has received increasing attention, and some studies have used methods such as positive-unlabeled learning to tackle this issue, but there is still a lot of room for improvement. Motivated by this, we propose a positive-augmentation and positivemixup positive-unlabeled metric learning framework (P 3 M). Specifically, we formulate document-level RE as a metric learning problem. We aim to pull the distance closer between entity pair embedding and their corresponding relation embedding, while pushing it farther away from the noneclass relation embedding. Additionally, we adapt the positiveunlabeled learning to this loss objective. In order to improve the generalizability of the model, we use dropout to augment positive samples and propose a positive-none-class mixup method. Extensive experiments show that P 3 M improves the F1 score by approximately 4-10 points in document-level RE with incomplete labeling, and achieves state-of-the-art results in fully labeled scenarios. Furthermore, P 3 M has also demonstrated robustness to prior estimation bias in incomplete labeled scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6155e84f-07e9-439b-94c1-a8be67050de7Cited by top-tier papers3
- LogicST: A Logical Self-Training Framework for Document-Level Relation Extraction with Incomplete AnnotationsShengda Fan, Yanting Wang, Shasha Mo, Jianwei NiuEMNLP 2024 · 6 citations
- Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial LabelsZixia Jia, Junpeng Li, Shichuan Zhang, Anji Liu et al.ACL 2024 · 2 citations
- Learning from Concealed LabelsZhongnian Li, Meng Wei, Peng Ying, Tongfeng Sun et al.ACM MM 2024
Builds on20
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Debiased Contrastive LearningChing-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba et al.NeurIPS 2020 · 761 citations
- SoftTriple Loss: Deep Metric Learning Without Triplet SamplingQi Qian, Lei Shang, Baigui Sun, Juhua Hu et al.ICCV 2019 · 419 citations
- Document-Level Relation Extraction with Adaptive Thresholding and Localized Context PoolingWenxuan Zhou, Kevin Huang, Tengyu Ma, Jing HuangAAAI 2021 · 360 citations
- MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text ClassificationJiaao Chen, Zichao Yang, Diyi YangACL 2020 · 340 citations
Related papers
- A Unified Positive-Unlabeled Learning Framework for Document-Level Relation Extraction with Different Levels of LabelingYe Wang, Xinxin Liu, Wenxin Hu, Tao ZhangEMNLP 2022 · 18 citations
- Improving Neural Relation Extraction with Positive and Unlabeled LearningZhengqiu He, Wenliang Chen, Yuyi Wang, Wei Zhang et al.AAAI 2020 · 18 citations
- RAPL: A Relation-Aware Prototype Learning Approach for Few-Shot Document-Level Relation ExtractionShiao Meng, Xuming Hu, Aiwei Liu, Shuang Li et al.EMNLP 2023 · 7 citations
- Who Is Your Right Mixup Partner in Positive and Unlabeled LearningChangchun Li, Ximing Li, Lei Feng, Jihong OuyangICLR 2022 · 36 citations
- TTM-RE: Memory-Augmented Document-Level Relation ExtractionChufan Gao, Xuan Wang, Jimeng SunACL 2024 · 11 citations
