ACL Findings2025
LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models
Xinxin Li, Huiyao Chen, Chengjun Liu, Jing Li, Meishan Zhang, Jun Yu, Min Zhang
Abstract
Semantic role labeling (SRL) is a crucial task of natural language processing (NLP). Although generative decoder-based large language models (LLMs) have achieved remarkable success across various NLP tasks, they still lag behind state-of-the-art encoder-decoder (BERT-like) models in SRL. In this work, we seek to bridge this gap by equipping LLMs for SRL with two mechanisms: (a) retrieval-augmented generation and (b) self-correction. The first mechanism enables LLMs to leverage external linguistic knowledge such as predicate and argument structure descriptions, while the second allows LLMs to identify and correct inconsistent SRL outputs. We conduct extensive experiments on three widely-used benchmarks of SRL (CPB1.0, CoNLL-2009, and CoNLL-2012). Results demonstrate that our method achieves state-of-the-art performance in both Chinese and English, marking the first successful application of LLMs to surpass encoderdecoder approaches in SRL.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on11
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- UnifiedQA: Crossing Format Boundaries With a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal et al.EMNLP Findings 2020 · 514 citations
- Semantics-Aware BERT for Language UnderstandingZhuosheng Zhang, Yuwei Wu, Hai Zhao, Zuchao Li et al.AAAI 2020 · 396 citations
- Better Combine Them Together! Integrating Syntactic Constituency and Dependency Representations for Semantic Role LabelingHao Fei, Shengqiong Wu, Yafeng Ren, Fei Li et al.ACL Findings 2021 · 82 citations
Related papers
- Probing for Predicate Argument Structures in Pretrained Language ModelsSimone Conia, Roberto NavigliACL 2022
- Encoder-Decoder Based Unified Semantic Role Labeling with Label-Aware SyntaxHao Fei, Fei Li, Bobo Li, Donghong JiAAAI 2021 · 60 citations
- End-to-end Semantic Role Labeling with Neural Transition-based ModelHao Fei, Meishan Zhang, Bobo Li, Donghong JiAAAI 2021 · 42 citations
- Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument StructuresSimone Conia, Edoardo Barba, Alessandro Scirè, Roberto NavigliEMNLP Findings 2022 · 2 citations
- Semantic Role Labeling as Syntactic Dependency ParsingTianze Shi, Igor Malioutov, Ozan IrsoyEMNLP 2020 · 15 citations
