EMNLP Findings2023
Learning to Correct Noisy Labels for Fine-Grained Entity Typing via Co-Prediction Prompt Tuning
Minghao Tang, Yongquan He, Yongxiu Xu, Hongbo Xu, Wenyuan Zhang, Yang Lin
Abstract
Fine-grained entity typing (FET) is an essential task in natural language processing that aims to assign semantic types to entities in text. However, FET poses a major challenge known as the noise labeling problem, whereby current methods rely on estimating noise distribution to identify noisy labels but are confused by diverse noise distribution deviation. To address this limitation, we introduce Co-Prediction Prompt Tuning for noise correction in FET, which leverages multiple prediction results to identify and correct noisy labels. Specifically, we integrate prediction results to recall labeled labels and utilize a differentiated margin to identify inaccurate labels. Moreover, we design an optimization objective concerning divergent copredictions during fine-tuning, ensuring that the model captures sufficient information and maintains robustness in noise identification. Experimental results on three widely-used FET datasets demonstrate that our noise correction approach significantly enhances the quality of various types of training samples, including those annotated using distant supervision, Chat-GPT, and crowdsourcing.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on9
- SELF: Learning to Filter Noisy Labels with Self-EnsemblingDuc Tam Nguyen, Chaithanya Kumar Mummadi, Thi-Phuong-Nhung Ngo, Thi Hoai Phuong Nguyen et al.ICLR 2020 · 354 citations
- Prompt-learning for Fine-grained Entity TypingNing Ding, Yulin Chen, Xu Han, Guangwei Xu et al.EMNLP Findings 2022 · 139 citations
- Improving Entity Linking by Modeling Latent Entity Type InformationShuang Chen, Jinpeng Wang, Feng Jiang, Chin-Yew LinAAAI 2020 · 71 citations
- Hierarchical Entity Typing via Multi-level Learning to RankTongfei Chen, Yunmo Chen, Benjamin Van DurmeACL 2020 · 51 citations
- Are Noisy Sentences Useless for Distant Supervised Relation Extraction?Yuming Shang, He Yan Huang, Xianling Mao, Xin Sun et al.AAAI 2020 · 39 citations
Related papers
- Leveraging Label Semantics and Entity Description Generation for LLM-based Fine-grained Entity TypingYingying Ma, Hongliang Dai, Xia Zhang, Piji LiACL Findings 2026
- Divide and Denoise: Learning from Noisy Labels in Fine-Grained Entity Typing with Cluster-Wise Loss CorrectionKunyuan Pang, Haoyu Zhang, Jie Zhou, Ting WangACL 2022 · 13 citations
- Ultra-Fine Entity Typing with Weak Supervision from a Masked Language ModelHongliang Dai, Yangqiu Song, Haixun WangACL 2021
- Fine-Grained Named Entity Typing over Distantly Supervised Data Based on Refined RepresentationsMuhammad Asif Ali, Yifang Sun, Bing Li, Wei WangAAAI 2020 · 33 citations
- From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grainedHongliang Dai, Ziqian ZengACL 2023 · 4 citations
