ACL Findings2025
ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type Descriptions
Alessio Cocchieri, Marcos Martínez Galindo, Giacomo Frisoni, Gianluca Moro, Claudio Sartori, Giuseppe Tagliavini
Abstract
What happens when a named entity recognition (NER) system encounters entities it has never seen before? In practical applications, models must generalize to unseen entity types where labeled training data is either unavailable or severely limited-a challenge that demands zero-shot learning capabilities. While large language models (LLMs) offer extensive parametric knowledge, they fall short in costeffectiveness compared to specialized small encoders. Existing zero-shot methods predominantly adopt a relaxed definition of the term with potential leakage issues and rely on entity type names for generalization, overlooking the value of richer descriptions for disambiguation. In this work, we introduce ZE-RONER, a description-driven framework that enhances hard zero-shot NER in low-resource settings. By leveraging general-domain annotations and entity type descriptions with LLM supervision, ZERONER enables a BERT-based student model to successfully identify unseen entity types. Evaluated on three real-world benchmarks, ZERONER consistently outperforms LLMs by up to 16% in F1 score, and surpasses lightweight baselines that use type names alone. Our analysis further reveals that LLMs derive significant benefits from incorporating type descriptions in the prompts. 1 * Equal contribution (co-first authorship). 1 Data, code, model: zeroner; research group website: unibo-nlp.github.io
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 3 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers3
- Sycophants in the Courtroom: Are LLMs Fragile to Juridical Authority and Evolving Legal Standards?Lorenzo Molfetta, Alessio Cocchieri, Luca Ragazzi, Ilaria Bartolini et al.ACL 2026 · 1 citation
- Can Large Language Models Win the International Mathematical Games?Alessio Cocchieri, Luca Ragazzi, Giuseppe Tagliavini, Lorenzo Tordi et al.EMNLP 2025
- Discovering Latent Facts from Context to Construct Richer Open Knowledge GraphsJinpeng Li, Hang Yu, Ziqi Ma, Peng QiAAAI 2026
Builds on10
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model SizesCheng-Yu Hsieh, Chun-Liang Li, Chih-Kuan Yeh, Hootan Nakhost et al.ACL Findings 2023 · 317 citations
- Large language models are few-shot clinical information extractorsMonica Agrawal, Stefan Hegselmann, Hunter Lang, Yoon Kim et al.EMNLP 2022 · 285 citations
- GoLLIE: Annotation Guidelines improve Zero-Shot Information-ExtractionOscar Sainz, Iker García-Ferrero, Rodrigo Agerri, Oier Lopez de Lacalle et al.ICLR 2024 · 168 citations
- NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated DataSergei Bogdanov, Alexandre Constantin, Timothée Bernard, Benoît Crabbé et al.EMNLP 2024 · 29 citations
Related papers
- Learning from Language Description: Low-shot Named Entity Recognition via Decomposed FrameworkYaqing Wang, Haoda Chu, Chao Zhang, Jing GaoEMNLP Findings 2021 · 39 citations
- NERetrieve: Dataset for Next Generation Named Entity Recognition and RetrievalUri Katz, Matan Vetzler, Amir David Nissan Cohen, Yoav GoldbergEMNLP Findings 2023 · 7 citations
- NER Retriever: Zero-Shot Named Entity Retrieval with Type-Aware EmbeddingsOr Shachar, Uri Katz, Yoav Goldberg, Oren GlickmanEMNLP Findings 2025 · 1 citation
- Just Pass Twice: Efficient Token Classification with LLMs for Zero-Shot NERAhmed Ewais, Ahmed Hashish, Amr AliACL 2026
- DiZiNER: Disagreement-guided Instruction Refinement via Simulating Pilot Annotation for Zero-shot Named Entity RecognitionSiun Kim, Hyung-Jin YoonACL 2026
