Learning First-Order Logic Rules for Argumentation Mining
Yang Sun, Guanrong Chen, Hamid Alinejad-Rokny, Jianzhu Bao, Yuqi Huang, Bin Liang, Kam-Fai Wong, Min Yang, Ruifeng Xu
Abstract
Argumentation Mining (AM) aims to extract argumentative structures from texts by identifying argumentation components (ACs) and their argumentative relations (ARs). While previous works focus on representation learning to encode ACs and AC pairs, they fail to explicitly model the underlying reasoning patterns of AM, resulting in limited interpretability. This paper proposes a novel First-Order Logic reasoning framework for AM (FOL-AM), designed to explicitly capture logical reasoning paths within argumentative texts. By interpreting multiple AM subtasks as a unified relation query task modeled using FOL rules, FOL-AM facilitates multi-hop relational reasoning and enhances interpretability. The framework supports two flexible implementations: a fine-tuned approach to leverage task-specific learning, and a promptbased method utilizing large language models to harness their generalization capabilities. Extensive experiments on two AM benchmarks demonstrate that FOL-AM outperforms strong baselines while significantly improving explainability. Kuribayashi et al. (2019b) enhances AC representations using discourse markers, while Bao et al. (2021a) employs a transition-based network for AC and AC pair modeling. Morio et al. (2022b) leverages biaffine functions to encode relational representations, and Sun et al. (2024) incorporates task interactions into AC and AC pair representations. However, these methods fail to explicitly model the reasoning patterns underlying AM, potentially leading to sub-optimal performance. Moreover, they lack interpretability, as they rely on black-box neural networks. For example, as shown in Figure 1 , the stateof-the-art (SOTA) model PITA misclassifies the relation between AC1 and AC5 as Attack due to their shared contextual cue increase taxes, whereas AC5 actually expresses a negative stance toward the topic. In contrast, humans can deduce the correct relation using logical reasoning, recognizing that "if AC1 promotes AC4, and AC4 entails AC5, then AC1 and AC5 are in a Support relation." In this paper, we propose a novel first-order logic reasoning framework for multi-task AM (FOL-AM). As indicated in Figure 1 , our method aligns with human reasoning by introducing interpretable FOL rules derived from the argumentative text for AM. For example, we may use the following logic rule to identify the relation between AC pair ๐ด๐ถ1 and ๐ด๐ถ5 as "Support": Support(AC1, AC5) โ Promotion 1 (AC1, AC4) โง Entailment(AC4, AC5). This logic reasoning framework has two clear benefits over previous approaches: First, it naturally captures multi-hop relations among ACs owing to the compositional structure of the reasoning chain. Second, it improves interpretability as the reasoning processes are visible. Specifically, we uniformly transform ACTC and ARC subtasks as relation query ๐(๐ฅ 1 , ๐ฅ ๐ฟ+1 ) associated with an AC pair (๐ฅ 1 , ๐ฅ ๐ฟ+1 ) within the argumentative text. The query is modeled as the FOL rule to conduct logical deduction: ). The body of the rule (on the left) is formed by attentively selecting proper ACs ๐ฅ ๐ and predicates ๐ ๐ upon given argumentative text. We implement the FOL-AM framework in two settings: a fine-tuned method and a prompt-based method using LLMs. Intuitively, the former method can learn the nuanced patterns specific to the AM task directly from the dataset,
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eac18bd8-0b24-466a-81d6-c983b19b6c0bBuilds on13
- Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 ยท 4,966 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 ยท 1,224 citations
- RNNLogic: Learning Logic Rules for Reasoning on Knowledge GraphsMeng Qu, Jun-Kun Chen, Louis-Pascal A. C. Xhonneux, Yoshua Bengio et al.ICLR 2021 ยท 230 citations
- AL: An Adaptive Learning Support System for Argumentation SkillsThiemo Wambsganss, Christina Niklaus, Matthias Cetto, Matthias Sรถllner et al.CHI 2020 ยท 98 citations
- LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic ProversTheo Olausson, Alex Gu, Benjamin Lipkin, Cedegao E. Zhang et al.EMNLP 2023 ยท 37 citations
Related papers
- PITA: Prompting Task Interaction for Argumentation MiningYang Sun, Muyi Wang, Jianzhu Bao, Bin Liang et al.ACL 2024
- A Neural Transition-based Model for Argumentation MiningJianzhu Bao, Chuang Fan, Jipeng Wu, Yixue Dang et al.ACL 2021
- PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language ModelsYu Liu, Xixun Lin, Yanmin Shang, Yangxi Li et al.AAAI 2026 ยท 3 citations
- Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining?Subhabrata Dutta, Jeevesh Juneja, Dipankar Das, Tanmoy ChakrabortyACL 2022
- Harnessing Toulmin's theory for zero-shot argument explicationAnkita Gupta, Ethan Zuckerman, Brendan T. O'ConnorACL 2024 ยท 4 citations
