Biomedical Named Entity Recognition via Dictionary-based Synonym Generalization
Zihao Fu, Yixuan Su, Zaiqiao Meng, Nigel Collier
Abstract
Biomedical named entity recognition is one of the core tasks in biomedical natural language processing (BioNLP). To tackle this task, numerous supervised/distantly supervised approaches have been proposed. Despite their remarkable success, these approaches inescapably demand laborious human effort. To alleviate the need of human effort, dictionarybased approaches have been proposed to extract named entities simply based on a given dictionary. However, one downside of existing dictionary-based approaches is that they are challenged to identify concept synonyms that are not listed in the given dictionary, which we refer as the synonym generalization problem. In this study, we propose a novel Synonym Generalization (SynGen) framework that recognizes the biomedical concepts contained in the input text using span-based predictions. In particular, SynGen introduces two regularization terms, namely, (1) a synonym distance regularizer; and (2) a noise perturbation regularizer, to minimize the synonym generalization error. To demonstrate the effectiveness of our approach, we provide a theoretical analysis of the bound of synonym generalization error. We extensively evaluate our approach on a wide range of benchmarks and the results verify that SynGen outperforms previous dictionary-based models by notable margins. Lastly, we provide a detailed analysis to further reveal the merits and inner-workings of our approach. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on8
- Sharpness-aware Minimization for Efficiently Improving GeneralizationPierre Foret, Ariel Kleiner, Hossein Mobahi, Behnam NeyshaburICLR 2021 · 1,861 citations
- Towards Understanding Sharpness-Aware MinimizationMaksym Andriushchenko, Nicolas FlammarionICML 2022 · 190 citations
- BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant SupervisionChen Liang, Yue Yu, Haoming Jiang, Siawpeng Er et al.KDD 2020 · 118 citations
- Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-TrainingYu Meng, Yunyi Zhang, Jiaxin Huang, Xuan Wang et al.EMNLP 2021 · 50 citations
- Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled LearningKang Zhou, Yuepei Li, Qi LiACL 2022 · 37 citations
Related papers
- Biomedical Entity Representations with Synonym MarginalizationMujeen Sung, Hwisang Jeon, Jinhyuk Lee, Jaewoo KangACL 2020 · 134 citations
- HAMNER: Headword Amplified Multi-Span Distantly Supervised Method for Domain Specific Named Entity RecognitionShifeng Liu, Yifang Sun, Bing Li, Wei Wang et al.AAAI 2020 · 28 citations
- BioFEG: Generate Latent Features for Biomedical Entity LinkingXuhui Sui, Ying Zhang, Xiangrui Cai, Kehui Song et al.EMNLP 2023 · 6 citations
- MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic PerspectiveXiao Wang, Shihan Dou, Limao Xiong, Yicheng Zou et al.ACL 2022 · 35 citations
- A Neural Transition-based Joint Model for Disease Named Entity Recognition and NormalizationZongcheng Ji, Tian Xia, Mei Han, Jing XiaoACL 2021
