Lune

ACL Findings2025

Learning from Negative Samples in Biomedical Generative Entity Linking

Chanhwi Kim, Hyunjae Kim, Sihyeon Park, Jiwoo Lee, Mujeen Sung, Jaewoo Kang

Abstract

Generative models have become widely used in biomedical entity linking (BioEL) due to their excellent performance and efficient memory usage. However, these models are usually trained only with positive samples, i.e., entities that match the input mention's identifier, and do not explicitly learn from hard negative samples, which are entities that look similar but have different meanings. To address this limitation, we introduce ANGEL (Learning from Negative Samples in Biomedical Generative Entity Linking), the first framework that trains generative BioEL models using negative samples. Specifically, a generative model is initially trained to generate positive entity names from the knowledge base for given input entities. Subsequently, both correct and incorrect outputs are gathered from the model's top-k predictions. Finally, the model is updated to prioritize the correct predictions through preference optimization. Our models outperform the previous best baseline models by up to an average top-1 accuracy of 1.4% on five benchmarks. When incorporating our framework into pre-training, the performance improvement increases further to 1.7%, demonstrating its effectiveness in both the pre-training and fine-tuning stages. The code and model weights are available at https://github.com/dmis-lab/ANGEL.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation cites Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  • SimPO: Simple Preference Optimization with a Reference-Free Reward cites Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
  • SimPO: Simple Preference Optimization with a Reference-Free Reward cites Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on11

  1. Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
  2. SimPO: Simple Preference Optimization with a Reference-Free RewardYu Meng, Mengzhou Xia, Danqi ChenNeurIPS 2024 · 1,203 citations
  3. Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationHaoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan et al.ICML 2024 · 447 citations
  4. Autoregressive Entity RetrievalNicola De Cao, Gautier Izacard, Sebastian Riedel, Fabio PetroniICLR 2021 · 200 citations
  5. Biomedical Entity Representations with Synonym MarginalizationMujeen Sung, Hwisang Jeon, Jinhyuk Lee, Jaewoo KangACL 2020 · 134 citations

Related papers

  1. Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive DecodingZhenxi Lin, Ziheng Zhang, Jian Wu, Yefeng Zheng et al.EMNLP Findings 2025 · 3 citations
  2. BioFEG: Generate Latent Features for Biomedical Entity LinkingXuhui Sui, Ying Zhang, Xiangrui Cai, Kehui Song et al.EMNLP 2023 · 6 citations
  3. Improving Biomedical Entity Linking with Cross-Entity InteractionZhenran Xu, Yulin Chen, Baotian HuAAAI 2023 · 12 citations
  4. A Comprehensive Evaluation of Biomedical Entity Linking ModelsDavid Kartchner, Jennifer Deng, Shubham Lohiya, Tejasri Kopparthi et al.EMNLP 2023 · 6 citations
  5. BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model AlignmentAndrey Sakhovskiy, Elena TutubalinaSIGIR 2025 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines