ACL Findings2023
Type Enhanced BERT for Correcting NER Errors
Kuai Li, Chen Chen, Tao Yang, Tianming Du, Peijie Yu, Dong Du, Feng Zhang
Abstract
We introduce the task of correcting named entity recognition (NER) errors without retraining the model. After a NER model is trained and deployed in production, it makes prediction errors, which usually need to be fixed quickly. To address this problem, we firstly construct a gazetteer containing named entities and corresponding possible entity types. And then, we propose type-enhanced BERT (TyBERT), a method that integrates the named entity's type information into BERT by an adapter layer. When errors are identified, we can repair the model by updating the gazetteer. In other words, the gazetteer becomes a trigger to control the NER model's output. The experiment results in multiple corpus show the effectiveness of our method, which outperforms strong baselines.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on3
- Lexicon Enhanced Chinese Sequence Labeling Using BERT AdapterWei Liu, Xiyan Fu, Yue Zhang, Wenming XiaoACL 2021
- Improving Named Entity Recognition by External Context Retrieving and Cooperative LearningXinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang et al.ACL 2021
- Few-NERD: A Few-shot Named Entity Recognition DatasetNing Ding, Guangwei Xu, Yulin Chen, Xiaobin Wang et al.ACL 2021
Related papers
- Toward Recognizing More Entity Types in NER: An Efficient Implementation using Only Entity LexiconsMinlong Peng, Ruotian Ma, Qi Zhang, Lujun Zhao et al.EMNLP Findings 2020 · 5 citations
- Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity RecognitionZihan Wang, Kewen Zhao, Zilong Wang, Jingbo ShangEMNLP Findings 2022 · 7 citations
- Entity Enhanced BERT Pre-training for Chinese NERChen Jia, Yuefeng Shi, Qinrong Yang, Yue ZhangEMNLP 2020 · 59 citations
- Continual Learning for Named Entity RecognitionNatawut Monaikul, Giuseppe Castellucci, Simone Filice, Oleg RokhlenkoAAAI 2021 · 84 citations
- Coarse-to-Fine Pre-training for Named Entity RecognitionMengge Xue, Bowen Yu, Zhenyu Zhang, Tingwen Liu et al.EMNLP 2020 · 49 citations
