Lune

ACL2025顶会

InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating

Fuyu Wang, Jiangtong Li, Kun Zhu, Changjun Jiang

2025年份
3被引次数
1顶会引用

摘要

With the rapid advancements in large language models (LLMs), debating tasks, such as argument quality assessment and debate process simulation, have made significant progress. However, existing LLM-based debating systems focus on responding to specific arguments while neglecting objective assessments such as authenticity and logical validity. Furthermore, these systems lack a structured approach to optimize across various dimensions−-including evaluation metrics, chain-of-thought (CoT) reasoning, and multi-turn debate refinement−-thereby limiting their effectiveness. To address these interconnected challenges, we propose a dual-component framework: (1) InspireScore\textbf{InspireScore}, a novel evaluation system that establishes a multi-dimensional assessment architecture incorporating four subjective criteria (emotional appeal, argument clarity, argument arrangement, and topic relevance) alongside two objective metrics (fact authenticity and logical validity); and (2) InspireDebate\textbf{InspireDebate}, an optimized debating framework employing a phased optimization approach through CoT reasoning enhancement, multi-dimensional Direct Preference Optimization (DPO), and real-time knowledge grounding via web-based Retrieval Augmented Generation (Web-RAG). Empirical evaluations demonstrate that InspireScore\textbf{InspireScore} achieves 44%\% higher correlation with expert judgments compared to existing methods, while InspireDebate\textbf{InspireDebate} shows significant improvements, outperforming baseline models by 57%\%. Source code is available at https://github.com/fywang12/InspireDebate.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

lune papers fulltext ae27c87a-c6bb-4999-8feb-e137968ee4e5

引用它的顶会 Paper1

问问它们各自怎么用它

它引用的顶会 Paper8

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖