A Unified Generative Framework for Various NER Subtasks
Hang Yan, Tao Gui, Junqi Dai, Qipeng Guo, Zheng Zhang, Xipeng Qiu
Abstract
Named Entity Recognition (NER) is the task of identifying spans that represent entities in sentences. Whether the entity spans are nested or discontinuous, the NER task can be categorized into the flat NER, nested NER, and discontinuous NER subtasks. These subtasks have been mainly solved by the token-level sequence labelling or span-level classification. However, these solutions can hardly tackle the three kinds of NER subtasks concurrently. To that end, we propose to formulate the NER subtasks as an entity span sequence generation task, which can be solved by a unified sequence-to-sequence (Seq2Seq) framework. Based on our unified framework, we can leverage the pre-trained Seq2Seq model to solve all three kinds of NER subtasks without the special design of the tagging schema or ways to enumerate spans. We exploit three types of entity representations to linearize entities into a sequence. Our proposed framework is easy-to-implement and achieves state-of-theart (SoTA) or near SoTA performance on eight English NER datasets, including two flat NER datasets, three nested NER datasets, and three discontinuous NER datasets 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9eb591a7-130e-41ff-854f-90c2eb52debfCited by top-tier papers47
- Unified Named Entity Recognition as Word-Word Relation ClassificationJingye Li, Hao Fei, Jiang Liu, Shengqiong Wu et al.AAAI 2022 · 340 citations
- UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion RecognitionGuimin Hu, Ting-En Lin, Yi Zhao, Guangming Lu et al.EMNLP 2022 · 206 citations
- Packed Levitated Marker for Entity and Relation ExtractionDeming Ye, Yankai Lin, Peng Li, Maosong SunACL 2022 · 140 citations
- LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language ModelHao Fei, Shengqiong Wu, Jingye Li, Bobo Li et al.NeurIPS 2022 · 114 citations
- DiffusionNER: Boundary Diffusion for Named Entity RecognitionYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li et al.ACL 2023 · 70 citations
Builds on8
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
- LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionIkuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda et al.EMNLP 2020 · 562 citations
- Pyramid: A Layered Model for Nested Named Entity RecognitionJue Wang, Lidan Shou, Ke Chen, Gang ChenACL 2020 · 167 citations
- Bipartite Flat-Graph Network for Nested Named Entity RecognitionYing Luo, Hai ZhaoACL 2020 · 84 citations
Related papers
- SetGNER: General Named Entity Recognition as Entity Set GenerationYuxin He, Buzhou TangEMNLP 2022 · 13 citations
- Boundary Enhanced Neural Span Classification for Nested Named Entity RecognitionChuanqi Tan, Wei Qiu, Mosha Chen, Rui Wang et al.AAAI 2020 · 125 citations
- Locate and Label: A Two-stage Identifier for Nested Named Entity RecognitionYongliang Shen, Xinyin Ma, Zeqi Tan, Shuai Zhang et al.ACL 2021
- Span Graph Transformer for Document-Level Named Entity RecognitionHongli Mao, Xian-Ling Mao, Hanlin Tang, Yuming Shang et al.AAAI 2024 · 3 citations
- De-Bias for Generative Extraction in Unified NER TaskShuai Zhang, Yongliang Shen, Zeqi Tan, Yiquan Wu et al.ACL 2022 · 59 citations
