Lune

ACL Findings2026

Decomposing Unitization and Typing for Efficient and Consistent Span-Bound Concept Annotation

Nupoor Gandhi, Michael Bada, Emma Strubell

Abstract

In specialized domains that require expert annotators and high inter-annotator agreement, high-quality datasets with span-bound semantic concept annotations remain expensive to develop. Substantial resources are typically spent on unitizing, the task of identifying precise span boundaries for entity mentions. Unitizing is a significant source of inter-annotator disagreement, a poor use of expensive domain expertise, and very time-consuming. We propose a lighter annotation procedure that concentrates manual efforts on typed position annotations, marking positions in the text that overlap with mentions of each entity type, abstracting away span boundary decisions. With as few as 100-200 example sentences, we train span boundary detection models to unitize typed position annotations. Through evaluation over three datasets: CRAFT (biomedical), GENIA (molecular biology), and POLIANNA (climate/energy policy text), we demonstrate that (1) annotating typed positions in the text instead of full concept annotation is a more efficient use of time in lowresource settings, and (2) model-inferred span boundaries result in higher agreement at both the annotator training and corpus annotation phases, without sacrificing utility.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction cites UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
  • GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction cites Language Models are Few-Shot Learners
  • Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again cites Language Models are Few-Shot Learners
  • Decomposed Meta-Learning for Few-Shot Named Entity Recognition cites Language Models are Few-Shot Learners
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on20

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. GoLLIE: Annotation Guidelines improve Zero-Shot Information-ExtractionOscar Sainz, Iker García-Ferrero, Rodrigo Agerri, Oier Lopez de Lacalle et al.ICLR 2024 · 168 citations
  3. UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity RecognitionWenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen et al.ICLR 2024 · 118 citations
  4. Thinking about GPT-3 In-Context Learning for Biomedical IE? Think AgainBernal Jimenez Gutierrez, Nikolas McNeal, Clayton Washington, You Chen et al.EMNLP Findings 2022 · 115 citations
  5. Decomposed Meta-Learning for Few-Shot Named Entity RecognitionTingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao et al.ACL Findings 2022 · 102 citations

Related papers

  1. Improved Latent Tree Induction with Distant Supervision via Span ConstraintsZhiyang Xu, Andrew Drozdov, Jay-Yoon Lee, Tim O'Gorman et al.EMNLP 2021 · 4 citations
  2. LATTE: Latent Type Modeling for Biomedical Entity LinkingMing Zhu, Busra Celikkaya, Parminder Bhatia, Chandan K. ReddyAAAI 2020 · 41 citations
  3. Seed-Guided Fine-Grained Entity Typing in Science and Engineering DomainsYu Zhang, Yunyi Zhang, Yanzhen Shen, Yu Deng et al.AAAI 2024 · 5 citations
  4. Annotating Mentions Alone Enables Efficient Domain Adaptation for Coreference ResolutionNupoor Gandhi, Anjalie Field, Emma StrubellACL 2023 · 3 citations
  5. Do UD Trees Match Mention Spans in Coreference Annotations?Martin Popel, Zdenek Zabokrtský, Anna Nedoluzhko, Michal Novák et al.EMNLP Findings 2021
Dusk over the sea between two cliffs drawn in fine vertical lines