Lune

ACL Findings2024

Rethinking Negative Instances for Generative Named Entity Recognition

Yuyang Ding, Juntao Li, Pinzheng Wang, Zecheng Tang, Yan Bowen, Min Zhang

Abstract

Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a broad range of entity domains via instruction tuning, by adopting entity-centric schema. In this work, we explore the potential enhancement of the existing methods by incorporating negative instances into training. Our experiments reveal that negative instances contribute to remarkable improvements by (1) introducing contextual information, and (2) clearly delineating label boundaries. Furthermore, we introduce an efficient longest common subsequence (LCS) matching algorithm, which is tailored to transform unstructured predictions into structured entities. By integrating these components, we present GNER, a Generative NER system that shows improved zero-shot performance across unseen entity domains. Our comprehensive evaluation illustrates our system's superiority, surpassing state-of-the-art (SoTA) methods by 9 F 1 score in zero-shot evaluation. 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • The Flan Collection: Designing Data and Methods for Effective Instruction Tuning cites Finetuned Language Models are Zero-Shot Learners
  • The Flan Collection: Designing Data and Methods for Effective Instruction Tuning cites Training language models to follow instructions with human feedback
  • DiZiNER: Disagreement-guided Instruction Refinement via Simulating Pilot Annotation for Zero-shot Named Entity Recognition cites CrossNER: Evaluating Cross-Domain Named Entity Recognition
  • PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity Recognition cites CrossNER: Evaluating Cross-Domain Named Entity Recognition
  • Finetuned Language Models are Zero-Shot Learners cites A Unified MRC Framework for Named Entity Recognition
  • Finetuned Language Models are Zero-Shot Learners cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites Finetuned Language Models are Zero-Shot Learners
  • Just Pass Twice: Efficient Token Classification with LLMs for Zero-Shot NER cites CrossNER: Evaluating Cross-Domain Named Entity Recognition
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity RecognitionJinghui Lu, Yanjie Wang, Ziwei Yang, Xuejing Liu et al.NeurIPS 2024 · 22 citations
  2. DiZiNER: Disagreement-guided Instruction Refinement via Simulating Pilot Annotation for Zero-shot Named Entity RecognitionSiun Kim, Hyung-Jin YoonACL 2026
  3. Just Pass Twice: Efficient Token Classification with LLMs for Zero-Shot NERAhmed Ewais, Ahmed Hashish, Amr AliACL 2026

Builds on12

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 · 4,966 citations
  3. The Flan Collection: Designing Data and Methods for Effective Instruction TuningShayne Longpre, Le Hou, Tu Vu, Albert Webson et al.ICML 2023 · 908 citations
  4. A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
  5. CrossNER: Evaluating Cross-Domain Named Entity RecognitionZihan Liu, Yan Xu, Tiezheng Yu, Wenliang Dai et al.AAAI 2021 · 201 citations

Related papers

  1. ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type DescriptionsAlessio Cocchieri, Marcos Martínez Galindo, Giacomo Frisoni, Gianluca Moro et al.ACL Findings 2025 · 3 citations
  2. ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language ModelsYuzhao Heng, Chunyuan Deng, Yitong Li, Yue Yu et al.ACL Findings 2024 · 16 citations
  3. GUIDEX: Guided Synthetic Data Generation for Zero-Shot Information ExtractionNeil De La Fuente, Oscar Sainz, Iker García-Ferrero, Eneko AgirreACL Findings 2025
  4. Pushing the Limits of Low-Resource NER Using LLM Artificial Data GenerationJoan Santoso, Patrick Sutanto, Billy Cahyadi, Esther Irawati SetiawanACL Findings 2024 · 12 citations
  5. Empirical Analysis of Unlabeled Entity Problem in Named Entity RecognitionYangming Li, Lemao Liu, Shuming ShiICLR 2021 · 72 citations
Dusk over the sea between two cliffs drawn in fine vertical lines