FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction
Tianshuo Peng, Zuchao Li, Lefei Zhang, Bo Du, Hai Zhao
Abstract
Universal Information Extraction (UIE) has been introduced as a unified framework for various Information Extraction (IE) tasks and has achieved widespread success. Despite this, UIE models have limitations. For example, they rely heavily on span boundaries in the data during training, which does not reflect the reality of span annotation challenges. Slight adjustments to positions can also meet requirements. Additionally, UIE models lack attention to the limited span length feature in IE. To address these deficiencies, we propose the Fuzzy Span Universal Information Extraction (FSUIE) framework. Specifically, our contribution consists of two concepts: fuzzy span loss and fuzzy span attention. Our experimental results on a series of main IE tasks show significant improvement compared to the baseline, especially in terms of fast convergence and strong performance with small amounts of data and training epochs. These results demonstrate the effectiveness and generalization of FSUIE in different tasks, settings, and scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4d801127-92b5-454e-ba8d-3c7142971aa2Cited by top-tier papers3
- A Novel Energy Based Model Mechanism for Multi-Modal Aspect-Based Sentiment AnalysisTianshuo Peng, Zuchao Li, Ping Wang, Lefei Zhang et al.AAAI 2024 · 22 citations
- Hypergraph based Understanding for Document Semantic Entity RecognitionQiwei Li, Zuchao Li, Ping Wang, Haojun Ai et al.ACL 2024 · 2 citations
- FLAIR: Steering LLM Mathematical Problem Solving based on A Fuzzy-Logic-AssIsted ReasonerHao Wu, Hongru Sun, Wanqing Li, Xinguo Yu et al.ACL 2026
Builds on20
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
- Reasoning with Latent Structure Refinement for Document-Level Relation ExtractionGuoshun Nan, Zhijiang Guo, Ivan Sekulic, Wei LuACL 2020 · 294 citations
- Position-Aware Tagging for Aspect Sentiment Triplet ExtractionLu Xu, Hao Li, Wei Lu, Lidong BingEMNLP 2020 · 264 citations
- A Joint Training Dual-MRC Framework for Aspect Based Sentiment AnalysisYue Mao, Yi Shen, Chao Yu, Longjun CaiAAAI 2021 · 243 citations
Related papers
- UniEX: An Effective and Efficient Framework for Unified Information Extraction via a Span-extractive PerspectiveYang Ping, Junyu Lu, Ruyi Gan, Junjie Wang et al.ACL 2023 · 4 citations
- Unified Structure Generation for Universal Information ExtractionYaojie Lu, Qing Liu, Dai Dai, Xinyan Xiao et al.ACL 2022
- LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language ModelHao Fei, Shengqiong Wu, Jingye Li, Bobo Li et al.NeurIPS 2022 · 114 citations
- UMIE: Unified Multimodal Information Extraction with Instruction TuningLin Sun, Kai Zhang, Qingyuan Li, Renze LouAAAI 2024
- UTC-IE: A Unified Token-pair Classification Architecture for Information ExtractionHang Yan, Yu Sun, Xiaonan Li, Yunhua Zhou et al.ACL 2023 · 8 citations
