Boundary Smoothing for Named Entity Recognition
Enwei Zhu, Jinpeng Li
Abstract
Neural named entity recognition (NER) models may easily encounter the over-confidence issue, which degrades the performance and calibration. Inspired by label smoothing and driven by the ambiguity of boundary annotation in NER engineering, we propose boundary smoothing as a regularization technique for span-based neural NER models. It re-assigns entity probabilities from annotated spans to the surrounding ones. Built on a simple but strong baseline, our model achieves results better than or competitive with previous stateof-the-art systems on eight well-known NER benchmarks. 1 Further empirical analysis suggests that boundary smoothing effectively mitigates over-confidence, improves model calibration, and brings flatter neural minima and more smoothed loss landscapes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab09f655-0f81-4d83-9b3d-1572746e7802Cited by top-tier papers11
- DiffusionNER: Boundary Diffusion for Named Entity RecognitionYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li et al.ACL 2023 · 70 citations
- PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang et al.ACL 2023 · 46 citations
- MCL-NER: Cross-Lingual Named Entity Recognition via Multi-View Contrastive LearningYing Mo, Jian Yang, Jiahao Liu, Qifan Wang et al.AAAI 2024 · 42 citations
- UTC-IE: A Unified Token-pair Classification Architecture for Information ExtractionHang Yan, Yu Sun, Xiaonan Li, Yunhua Zhou et al.ACL 2023 · 8 citations
- FSUIE: A Novel Fuzzy Span Mechanism for Universal Information ExtractionTianshuo Peng, Zuchao Li, Lefei Zhang, Bo Du et al.ACL 2023 · 6 citations
Builds on7
- Fantastic Generalization Measures and Where to Find ThemYiding Jiang, Behnam Neyshabur, Hossein Mobahi, Dilip Krishnan et al.ICLR 2020 · 705 citations
- A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han et al.ACL 2020 · 617 citations
- Does label smoothing mitigate label noise?Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv KumarICML 2020 · 411 citations
- Simplify the Usage of Lexicon in Chinese NERRuotian Ma, Minlong Peng, Qi Zhang, Zhongyu Wei et al.ACL 2020 · 286 citations
- Locate and Label: A Two-stage Identifier for Nested Named Entity RecognitionYongliang Shen, Xinyin Ma, Zeqi Tan, Shuai Zhang et al.ACL 2021
Related papers
- Adaptive Label Smoothing with Self-Knowledge in Natural Language GenerationDongkyu Lee, Ka Chun Cheung, Nevin L. ZhangEMNLP 2022 · 5 citations
- Boundary Enhanced Neural Span Classification for Nested Named Entity RecognitionChuanqi Tan, Wei Qiu, Mosha Chen, Rui Wang et al.AAAI 2020 · 125 citations
- Effective Named Entity Recognition with Boundary-aware Bidirectional Neural NetworksFei Li, Zheng Wang, Siu Cheung Hui, Lejian Liao et al.WWW 2021 · 20 citations
- Modularized Interaction Network for Named Entity RecognitionFei Li, Zheng Wang, Siu Cheung Hui, Lejian Liao et al.ACL 2021
- TEBNER: Domain Specific Named Entity Recognition with Type Expanded Boundary-aware NetworkZheng Fang, Yanan Cao, Tai Li, Ruipeng Jia et al.EMNLP 2021 · 13 citations
