ACL Findings2024
A Survey on Predicting the Factuality and the Bias of News Media
Preslav Nakov, Jisun An, Haewoon Kwak, Muhammad Arslan Manzoor, Zain Muhammad Mujahid, Husrev T. Sencar
Abstract
The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. An increasing number of scholars are focusing on a coarser granularity, aiming to profile entire news outlets, which allows fast identification of potential "fake news" by checking the reliability of their source. Source factuality is also an important element of systems for automatic fact-checking and "fake news" detection, as they need to assess the reliability of the evidence they retrieve online. Political bias detection, which in the Western political landscape is about predicting left-centerright bias, is an equally important topic, which has experienced a similar shift toward profiling entire news outlets. Moreover, there is a clear connection between the two, as highly biased media are less likely to be factual; yet, the two problems have been addressed separately. In this survey, we review the state of the art on media profiling for factuality and bias, arguing for the need to model them jointly. We also shed light on some of the major challenges for modeling bias and factuality jointly. We further discuss interesting recent advances in using different information sources and modalities, which go beyond the text of the articles the target news outlet has published. Finally, we discuss current challenges and outline future research directions.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 2 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers2
- PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-EncoderYiqun Sun, Qiang Huang, Anthony Kum Hoe Tung, Jun YuACL 2025 · 2 citations
- The Psychology of Falsehood: A Human-Centric Survey of Misinformation DetectionArghodeep Nandi, Megha Sundriyal, Euna Mehnaz Khan, Jikai Sun et al.EMNLP 2025
Builds on11
- Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen et al.EMNLP 2023 · 449 citations
- PREDATOR: Proactive Recognition and Elimination of Domain Abuse at Time-Of-RegistrationShuang Hao, Alex Kantchelian, Brad Miller, Vern Paxson et al.CCS 2016 · 133 citations
- Predicting the Topical Stance and Political Leaning of Media using TweetsPeter Stefanov, Kareem Darwish, Atanas Atanasov, Preslav NakovACL 2020 · 80 citations
- Neural Media Bias Detection Using Distant Supervision With BABE - Bias Annotations By ExpertsTimo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas et al.EMNLP Findings 2021 · 70 citations
- Under the Shadow of Sunshine: Understanding and Detecting Bulletproof Hosting on Legitimate Service Provider NetworksSumayah A. Alrwais, Xiaojing Liao, Xianghang Mi, Peng Wang et al.S&P 2017 · 51 citations
Related papers
- What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media ContextRamy Baly, Georgi Karadzhov, Jisun An, Haewoon Kwak et al.ACL 2020 · 2 citations
- Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human ExpertsZain Muhammad Mujahid, Dilshod Azizov, Maha Tufail Agro, Preslav NakovACL Findings 2025 · 10 citations
- GREENER: Graph Neural Networks for News Media ProfilingPanayot Panayotov, Utsav Shukla, Husrev Taha Sencar, Mohamed Nabeel et al.EMNLP 2022 · 10 citations
- SAFARI: Cross-lingual Bias and Factuality Detection in News Media and News ArticlesDilshod Azizov, Zain Muhammad Mujahid, Hilal AlQuabeh, Preslav Nakov et al.EMNLP Findings 2024 · 2 citations
- That's Fake News! Reliability of News When Provided Title, Image, Source Bias & Full ArticleFrancesca Spezzano, Anu Shrestha, Jerry Alan Fails, Brian W. StoneCSCW 2021 · 22 citations
