Lune

CHI2020Top-tier venue

Will the Crowd Game the Algorithm?: Using Layperson Judgments to Combat Misinformation on Social Media by Downranking Distrusted Sources

Ziv Epstein, Gordon Pennycook, David G. Rand

Abstract

How can social media platforms fight the spread of misinformation? One possibility is to use newsfeed algorithms to downrank content from sources that users rate as untrustworthy. But will laypeople be handicapped by motivated reasoning or lack of expertise, and thus unable to identify misinformation sites? And will they "game" this crowdsourcing mechanism in order to promote content that aligns with their partisan agendas? We conducted a survey experiment in which =984 Americans indicated their trust in numerous news sites. To study the tendency of people to game the system, half of the participants were told their responses would inform social media ranking algorithms. Participants trusted mainstream sources much more than hyper-partisan or fake news sources, and their ratings were highly correlated with professional fact-checker judgments. Critically, informing participants that their responses would influence ranking algorithms did not diminish these results, despite the manipulation increasing the political polarization of trust ratings.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

28 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

its abstract · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Media cites Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria
  • Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions cites Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Media
  • Did the Roll-Out of Community Notes Reduce Engagement With Misinformation on X/Twitter? cites Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers28

  1. Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human SolutionsJiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G. Parker et al.CHI 2023 · 283 citations
  2. Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social MediaFarnaz Jahanbakhsh, Amy X. Zhang, Adam J. Berinsky, Gordon Pennycook et al.CSCW 2021 · 116 citations
  3. Effect of Information Presentation on Fairness Perceptions of Machine Learning PredictorsNiels van Berkel, Jorge Gonçalves, Daniel Russo, Simo Hosio et al.CHI 2021 · 84 citations
  4. Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert CriteriaMd Momen Bhuiyan, Amy X. Zhang, Connie Moon Sehat, Tanushree MitraCSCW 2020 · 70 citations
  5. Did the Roll-Out of Community Notes Reduce Engagement With Misinformation on X/Twitter?Yuwei Chuai, Haoye Tian, Nicolas Pröllochs, Gabriele LenziniCSCW 2024 · 62 citations

Related papers

  1. Understanding Effects of Algorithmic vs. Community Label on Perceived Accuracy of Hyper-partisan MisinformationChenyan Jia, Alexander Boltz, Angie Zhang, Anqing Chen et al.CSCW 2022 · 47 citations
  2. Remove, Reduce, Inform: What Actions do People Want Social Media Platforms to Take on Potentially Misleading Content?Shubham Atreja, Libby Hemphill, Paul ResnickCSCW 2023 · 22 citations
  3. Social Media Misinformation and Voting Intentions: Older Adults' Experiences with Manipulative NarrativesFilipo Sharevski, Jennifer Vander Loop, Sanchari DasCSCW 2025 · 4 citations
  4. Leveraging Structured Trusted-Peer Assessments to Combat MisinformationFarnaz Jahanbakhsh, Amy X. Zhang, David R. KargerCSCW 2022 · 41 citations
  5. Simple changes to content curation algorithms affect the beliefs people form in a collaborative filtering experimentJason W. Burton, Stefan M. Herzog, Philipp Lorenz-SpreenCHI 2026 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines