A Lightweight Neural Model for Biomedical Entity Linking
Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
Abstract
Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base. The specific challenge in this context is that the same biomedical entity can have a wide range of names, including synonyms, morphological variations, and names with different word orderings. Recently, BERT-based methods have advanced the state-of-the-art by allowing for rich representations of word sequences. However, they often have hundreds of millions of parameters and require heavy computing resources, which limits their applications in resource-limited scenarios. Here, we propose a lightweight neural method for biomedical entity linking, which needs just a fraction of the parameters of a BERT model and much less computing resources. Our method uses a simple alignment layer with attention mechanisms to capture the variations between mention and entity names. Yet, we show that our model is competitive with previous work on standard evaluation benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 536fa8cd-df66-4add-b561-d72b2ea28fcfCited by top-tier papers1
Ask how each one uses itBuilds on3
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesZhiqing Sun, Hongkun Yu, Xiaodan Song, Renjie Liu et al.ACL 2020 · 660 citations
- Dynamic Graph Convolutional Networks for Entity LinkingJunshuang Wu, Richong Zhang, Yongyi Mao, Hongyu Guo et al.WWW 2020 · 34 citations
Related papers
- Improving Biomedical Entity Linking with Cross-Entity InteractionZhenran Xu, Yulin Chen, Baotian HuAAAI 2023 · 12 citations
- BioFEG: Generate Latent Features for Biomedical Entity LinkingXuhui Sui, Ying Zhang, Xiangrui Cai, Kehui Song et al.EMNLP 2023 · 6 citations
- LATTE: Latent Type Modeling for Biomedical Entity LinkingMing Zhu, Busra Celikkaya, Parminder Bhatia, Chandan K. ReddyAAAI 2020 · 41 citations
- Improving Entity Linking by Modeling Latent Entity Type InformationShuang Chen, Jinpeng Wang, Feng Jiang, Chin-Yew LinAAAI 2020 · 71 citations
- A Comprehensive Evaluation of Biomedical Entity Linking ModelsDavid Kartchner, Jennifer Deng, Shubham Lohiya, Tejasri Kopparthi et al.EMNLP 2023 · 6 citations
