EMNLP Findings2021
Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning
Xinghua Zhang, Bowen Yu, Tingwen Liu, Zhenyu Zhang, Jiawei Sheng, Mengge Xue, Hongbo Xu
Abstract
Distantly supervised named entity recognition (DS-NER) efficiently reduces labor costs but meanwhile intrinsically suffers from the label noise due to the strong assumption of distant supervision. Typically, the wrongly labeled instances comprise numbers of incomplete and inaccurate annotation noise, while most prior denoising works are only concerned with one kind of noise and fail to fully explore useful information in the whole training set. To address this issue, we propose a robust learning paradigm named Self-Collaborative Denoising Learning (SCDL), which jointly trains two teacher-student networks in a mutuallybeneficial manner to iteratively perform noisy label refinery. Each network is designed to exploit reliable labels via self denoising, and two networks communicate with each other to explore unreliable annotations by collaborative denoising. Extensive experimental results on five real-world datasets demonstrate that SCDL is superior to state-of-the-art DS-NER denoising methods 1 .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
5 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble cites BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision
- Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble cites Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition
- Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble cites Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
- Biomedical Named Entity Recognition via Dictionary-based Synonym Generalization cites BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision
- Debiased and Denoised Entity Recognition from Distant Supervision cites Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble
- Debiased and Denoised Entity Recognition from Distant Supervision cites BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision
- Debiased and Denoised Entity Recognition from Distant Supervision cites Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition
- Debiased and Denoised Entity Recognition from Distant Supervision cites DivideMix: Learning with Noisy Labels as Semi-supervised Learning
- Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFs cites Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble
- Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFs cites BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision
- Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFs cites Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition
Cited by top-tier papers5
- Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student EnsembleXiaoye Qu, Jun Zeng, Daizong Liu, Zhefeng Wang et al.AAAI 2023 · 28 citations
- Biomedical Named Entity Recognition via Dictionary-based Synonym GeneralizationZihao Fu, Yixuan Su, Zaiqiao Meng, Nigel CollierEMNLP 2023 · 6 citations
- Representation and Labeling Gap Bridging for Cross-lingual Named Entity RecognitionXinghua Zhang, Bowen Yu, Jiangxia Cao, Quangang Li et al.SIGIR 2023 · 5 citations
- Debiased and Denoised Entity Recognition from Distant SupervisionHaobo Wang, Yiwen Dong, Ruixuan Xiao, Fei Huang et al.NeurIPS 2023 · 5 citations
- Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFsJian Liu, Weichang Liu, Yufeng Chen, Jinan Xu et al.EMNLP 2023 · 3 citations
Builds on8
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
- O2U-Net: A Simple Noisy Label Detection Approach for Deep Neural NetworksJinchi Huang, Lie Qu, Rongfei Jia, Binqiang ZhaoICCV 2019 · 276 citations
- BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant SupervisionChen Liang, Yue Yu, Haoming Jiang, Siawpeng Er et al.KDD 2020 · 118 citations
- Empirical Analysis of Unlabeled Entity Problem in Named Entity RecognitionYangming Li, Lemao Liu, Shuming ShiICLR 2021 · 72 citations
Related papers
- Improving the Robustness of Distantly-Supervised Named Entity Recognition via Uncertainty-Aware Teacher Learning and Student-Student Collaborative LearningShuzheng Si, Helan Hu, Haozhe Zhao, Shuang Zeng et al.ACL Findings 2024
- Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-TrainingYu Meng, Yunyi Zhang, Jiaxin Huang, Xuan Wang et al.EMNLP 2021 · 50 citations
- CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity RecognitionTingting Ma, Qianhui Wu, Huiqiang Jiang, Börje Karlsson et al.ACL 2023 · 5 citations
- MProto: Multi-Prototype Network with Denoised Optimal Transport for Distantly Supervised Named Entity RecognitionShuhui Wu, Yongliang Shen, Zeqi Tan, Wenqi Ren et al.EMNLP 2023 · 4 citations
- Denoising Distantly Supervised Named Entity Recognition via a Hypergeometric Probabilistic ModelWenkai Zhang, Hongyu Lin, Xianpei Han, Le Sun et al.AAAI 2021 · 13 citations
