Out of the Echo Chamber: Detecting Countering Debate Speeches
Matan Orbach, Yonatan Bilu, Assaf Toledo, Dan Lahav, Michal Jacovi, Ranit Aharonov, Noam Slonim
Abstract
An educated and informed consumption of media content has become a challenge in modern times. With the shift from traditional news outlets to social media and similar venues, a major concern is that readers are becoming encapsulated in "echo chambers" and may fall prey to fake news and disinformation, lacking easy access to dissenting views. We suggest a novel task aiming to alleviate some of these concerns -- that of detecting articles that most effectively counter the arguments -- and not just the stance -- made in a given text. We study this problem in the context of debate speeches. Given such a speech, we aim to identify, from among a set of speeches on the same topic and with an opposing stance, the ones that directly counter it. We provide a large dataset of 3,685 such speeches (in English), annotated for this relation, which hopefully would be of general interest to the NLP community. We explore several algorithms addressing this task, and while some are successful, all fall short of expert human performance, suggesting room for further research. All data collected during this work is freely available for research.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 161e540b-ed13-4740-8367-be7450e2dd1aCited by top-tier papers2
- Debatable Intelligence: Benchmarking LLM Judges via Debate Speech EvaluationNoy Sternlicht, Ariel Gera, Roy Bar-Haim, Tom Hope et al.EMNLP 2025 · 1 citation
- Large Language Models Often Say One Thing and Do AnotherRuoxi Xu, Hongyu Lin, Xianpei Han, Jia Zheng et al.ICLR 2025
Related papers
- A Transformer-based Framework for Neutralizing and Reversing the Political Polarity of News ArticlesRuibo Liu, Chenyan Jia, Soroush VosoughiCSCW 2021 · 25 citations
- Unsupervised stance detection for arguments from consequencesJonathan Kobbe, Ioana Hulpus, Heiner StuckenschmidtEMNLP 2020 · 27 citations
- Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not ArgumentsMarc Feger, Katarina Boland, Stefan DietzeACL 2025
- EZ-STANCE: A Large Dataset for English Zero-Shot Stance DetectionChenye Zhao, Cornelia CarageaACL 2024
- HearHere: Mitigating Echo Chambers in News Consumption through an AI-based Web SystemYoungseung Jeon, Jaehoon Kim, Sohyun Park, Yun-Yong Ko et al.CSCW 2024 · 9 citations
