Evaluation and Facilitation of Online Discussions in the LLM Era: A Survey
Katerina Korre, Dimitris Tsirmpas, Nikos Gkoumas, Emma Cabalé, Danai Myrtzani, Theodoros Evgeniou, Ion Androutsopoulos, John Pavlopoulos
Abstract
We present a survey of methods for assessing and enhancing the quality of online discussions, focusing on the potential of Large Language Models (LLMs). While online discourses aim, at least in theory, to foster mutual understanding, they often devolve into harmful exchanges, such as hate speech, threatening social cohesion and democratic values. Recent advancements in LLMs enable artificial facilitation agents to not only moderate content, but also actively improve the quality of interactions. Our survey synthesizes ideas from Natural Language Processing (NLP) and Social Sciences to provide (a) a new taxonomy on discussion quality evaluation, (b) an overview of intervention and facilitation strategies, (c) along with a new taxonomy of conversation facilitation datasets, (d) an LLM-oriented roadmap of good practices and future research directions, from technological and societal perspectives.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 024c7d66-8b55-4d73-9b81-995776745f2aCited by top-tier papers3
- Question the Questions: Auditing Representation in Online Deliberative ProcessesSoham De, Lodewijk Gelauff, Ashish Goel, Smitha Milli et al.WWW 2026 · 1 citation
- PerspectiveMod: A Perspectivist Resource for Deliberative ModerationEva Maria Vecchi, Neele Falk, Carlotta Quensel, Iman Jundi et al.EMNLP 2025
- Wait! There's a Way Out: A Decision Mechanism for Forecasting Conversational DerailmentLaerdon Kim, Vivian Nguyen, Cristian Danescu-Niculescu-MizilACL 2026
Builds on24
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject StudiesGati V. Aher, Rosa I. Arriaga, Adam Tauman KalaiICML 2023 · 651 citations
- Social Simulacra: Creating Populated Prototypes for Social Computing SystemsJoon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris et al.UIST 2022 · 192 citations
- Heuristic Evaluation of Conversational AgentsRaina Langevin, Ross J. Lordon, Thi Avrahami, Benjamin R. Cowan et al.CHI 2021 · 159 citations
- Reconsidering Self-Moderation: the Role of Research in Supporting Community-Based Models for Online Content ModerationJoseph SeeringCSCW 2020 · 151 citations
Related papers
- Supporting Human Raters with the Detection of Harmful Content Using Large Language ModelsKurt Thomas, Patrick Gage Kelley, David Tao, Sarah Meiklejohn et al.S&P 2025
- Multi-LLM Debate: Framework, Principals, and InterventionsAndrew Estornell, Yang LiuNeurIPS 2024 · 131 citations
- Outcome-Constrained Large Language Models for Countering Hate SpeechLingzi Hong, Pengcheng Luo, Eduardo Blanco, Xiaoying SongEMNLP 2024 · 5 citations
- Examining Human-AI Collaboration for Co-Writing Constructive Comments OnlineFarhana Shahid, Maximilian Dittgen, Mor Naaman, Aditya VashisthaCSCW 2025 · 2 citations
- Collecting Qualitative Data at Scale with Large Language Models: A Case StudyAlejandro Cuevas Villalba, Jennifer V. Scurrell, Eva Maxfield Brown, Jason Entenmann et al.CSCW 2025 · 14 citations
