Let's discuss! Quality Dimensions and Annotated Datasets for Computational Argument Quality Assessment
Rositsa V. Ivanova, Thomas Huber, Christina Niklaus
Abstract
Research in the computational assessment of Argumentation Quality has gained popularity over the last ten years. Various quality dimensions have been explored through the creation of domain-specific datasets and assessment methods. We survey the related literature (211 publications and 32 datasets), while addressing potential overlaps and blurry boundaries to related domains. This paper provides a representative overview of the state of the art in Computational Argument Quality Assessment with a focus on annotated datasets. The aim of the survey is to identify research gaps and to aid future discussions and work in the domain.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a132d886-aa16-463d-8015-e91987984570Builds on15
- A Large-Scale Dataset for Argument Quality Ranking: Construction and AnalysisShai Gretz, Roni Friedman, Edo Cohen-Karlik, Assaf Toledo et al.AAAI 2020 · 148 citations
- SODA: Million-scale Dialogue Distillation with Social Commonsense ContextualizationHyunwoo Kim, Jack Hessel, Liwei Jiang, Peter West et al.EMNLP 2023 · 60 citations
- Modeling Persuasive Discourse to Adaptively Support Students' Argumentative WritingThiemo Wambsganss, Christina NiklausACL 2022 · 25 citations
- Efficient Pairwise Annotation of Argument QualityLukas Gienapp, Benno Stein, Matthias Hagen, Martin PotthastACL 2020 · 17 citations
- Multitask Instruction-based Prompting for Fallacy RecognitionTariq Alhindi, Tuhin Chakrabarty, Elena Musi, Smaranda MuresanEMNLP 2022 · 16 citations
Related papers
- ArgAnalysis35K : A large-scale dataset for Argument Quality AnalysisOmkar Joshi, Priya Pitre, Yashodhara HaribhaktaACL 2023 · 4 citations
- A Multi-persona Framework for Argument Quality AssessmentBojun Jin, Jianzhu Bao, Yufang Hou, Yang Sun et al.ACL 2025
- Quantitative argument summarization and beyond: Cross-domain key point analysisRoy Bar-Haim, Yoav Kantor, Lilach Eden, Roni Friedman et al.EMNLP 2020 · 2 citations
- CEDAR: A Chinese Evaluation Dataset for Computational ArgumentationTian Lan, Jiang Li, Rong Yan, Feilong Bao et al.ACL 2026
- Exploring the Potential of Large Language Models in Computational ArgumentationGuizhen Chen, Liying Cheng, Anh Tuan Luu, Lidong BingACL 2024 · 8 citations
