EMNLP Findings2022
Improving Few-Shot Domain Transfer for Named Entity Disambiguation with Pattern Exploitation
Abstract
Named entity disambiguation (NED) is a critical subtask of entity linking, which seeks to connect knowledge base entities with textual mentions of those entities. Naturally, the performance of a model depends on the domain it was trained on; thus, reducing the amount of data required to train models is advantageous. In this work, we leverage recent research on pattern exploitation for NED and explore whether it can reduce the amount of data required for domain adaptation by reformulating the disambiguation task as a masked language modeling problem. Using ADAPET (Tam et al., 2021), which implements a new approach for few-shot learning using fine-tuned transformerbased language models, we produce an NED model which yields, without any sacrifice of in-domain accuracy, a 7% improvement in zeroshot cross-domain performance as evaluated on NEDMed, a new NED dataset of mental health news which we release with this work.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Related papers
- MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity RecognitionJinyuan Fang, Xiaobin Wang, Zaiqiao Meng, Pengjun Xie et al.ACL 2023 · 13 citations
- OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model PromptingXukai Liu, Ye Liu, Kai Zhang, Kehang Wang et al.EMNLP 2024 · 7 citations
- Task-adaptive Label Dependency Transfer for Few-shot Named Entity RecognitionShan Zhang, Bin Cao, Tianming Zhang, Yuqi Liu et al.ACL Findings 2023 · 5 citations
- Effective Few-Shot Named Entity Linking by Meta-LearningXiuxing Li, Zhenyu Li, Zhengyan Zhang, Ning Liu et al.ICDE 2022 · 14 citations
- Cross-Domain Data Integration for Named Entity Disambiguation in Biomedical TextMaya Varma, Laurel J. Orr, Sen Wu, Megan Leszczynski et al.EMNLP Findings 2021 · 17 citations
