True or False: Studying the Work Practices of Professional Fact-Checkers
Nicholas Micallef, Vivienne Armacost, Nasir D. Memon, Sameer Patil
Abstract
Misinformation has developed into a critical societal threat that can lead to disastrous societal consequences. Although fact-checking plays a key role in combating misinformation, relatively little research has empirically investigated work practices of professional fact-checkers. To address this gap, we conducted semi-structured interviews with 21 fact-checkers from 19 countries. The participants reported being inundated with information that needs filtering and prioritizing prior to fact-checking. The interviews surfaced a pipeline of practices fragmented across disparate tools that lack integration. Importantly, fact-checkers lack effective mechanisms for disseminating the outcomes of their efforts which prevents their work from fully achieving its potential impact. We found that the largely manual and labor intensive nature of current fact-checking practices is a barrier to scale. We apply these findings to propose a number of suggestions that can improve the effectiveness, efficiency, scale, and reach of fact-checking work and its outcomes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2b519214-3c72-4674-99e6-ae327c0becaaCited by top-tier papers19
- Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human SolutionsJiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G. Parker et al.CHI 2023 · 283 citations
- Did the Roll-Out of Community Notes Reduce Engagement With Misinformation on X/Twitter?Yuwei Chuai, Haoye Tian, Nicolas Pröllochs, Gabriele LenziniCSCW 2024 · 62 citations
- Diffusion of Community Fact-Checked Misinformation on TwitterChiara Patricia Drolsbach, Nicolas PröllochsCSCW 2023 · 47 citations
- Mechanisms of True and False Rumor Sharing in Social Media: Collective Intelligence or Herd Behavior?Nicolas Pröllochs, Stefan FeuerriegelCSCW 2023 · 31 citations
- Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIHoujiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou et al.CSCW 2024 · 23 citations
Builds on6
- Effects of Credibility Indicators on Social Media News Sharing IntentWaheeb Yaqub, Otari Kakhidze, Morgan L. Brockman, Nasir D. Memon et al.CHI 2020 · 170 citations
- Combating Misinformation in Bangladesh: Roles and Responsibilities as Perceived by Journalists, Fact-checkers, and UsersMd Mahfuzul Haque, Mohammad Yousuf, Ahmed Shatil Alam, Pratyasha Saha et al.CSCW 2020 · 84 citations
- Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert CriteriaMd Momen Bhuiyan, Amy X. Zhang, Connie Moon Sehat, Tanushree MitraCSCW 2020 · 70 citations
- Lyra 2: Designing Interactive Visualizations by DemonstrationJonathan Zong, Dhiraj Barnwal, Rupayan Neogy, Arvind SatyanarayanIEEE VIS 2020 · 50 citations
- On the Misinformation Beat: Understanding the Work of Investigative Journalists Reporting on Problematic Information OnlineMelinda McClure Haughey, Meena Devii Muralikumar, Cameron A. Wood, Kate StarbirdCSCW 2020 · 48 citations
Related papers
- Human and Technological Infrastructures of Fact-checkingPrerna Juneja, Tanushree MitraCSCW 2022 · 59 citations
- Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-CheckingGreta Warren, Irina Shklovski, Isabelle AugensteinCHI 2025 · 15 citations
- Tactics, Threats & Targets: Modeling Disinformation and its MitigationMuhammad Shujaat Mirza, Labeeba Begum, Liang Niu, Sarah Pardo et al.NDSS 2023
- Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for MisinformationMax Glockner, Yufang Hou, Iryna GurevychEMNLP 2022 · 23 citations
- Misinformation as a Harm: Structured Approaches for Fact-Checking PrioritizationConnie Moon Sehat, Ryan Li, Peipei Nie, Tarunima Prabhakar et al.CSCW 2024 · 22 citations
