Lune

ACL2025Top-tier venue

InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating

Fuyu Wang, Jiangtong Li, Kun Zhu, Changjun Jiang

2025Year
3Citations
1Top-tier citations

Abstract

With the rapid advancements in large language models (LLMs), debating tasks, such as argument quality assessment and debate process simulation, have made significant progress. However, existing LLM-based debating systems focus on responding to specific arguments while neglecting objective assessments such as authenticity and logical validity. Furthermore, these systems lack a structured approach to optimize across various dimensions−-including evaluation metrics, chain-of-thought (CoT) reasoning, and multi-turn debate refinement−-thereby limiting their effectiveness. To address these interconnected challenges, we propose a dual-component framework: (1) InspireScore\textbf{InspireScore}, a novel evaluation system that establishes a multi-dimensional assessment architecture incorporating four subjective criteria (emotional appeal, argument clarity, argument arrangement, and topic relevance) alongside two objective metrics (fact authenticity and logical validity); and (2) InspireDebate\textbf{InspireDebate}, an optimized debating framework employing a phased optimization approach through CoT reasoning enhancement, multi-dimensional Direct Preference Optimization (DPO), and real-time knowledge grounding via web-based Retrieval Augmented Generation (Web-RAG). Empirical evaluations demonstrate that InspireScore\textbf{InspireScore} achieves 44%\% higher correlation with expert judgments compared to existing methods, while InspireDebate\textbf{InspireDebate} shows significant improvements, outperforming baseline models by 57%\%. Source code is available at https://github.com/fywang12/InspireDebate.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext ae27c87a-c6bb-4999-8feb-e137968ee4e5

Cited by top-tier papers1

Ask how each one uses it

Builds on8

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines