"At the End of the Day Facebook Does What ItWants": How Users Experience Contesting Algorithmic Content Moderation
Kristen Vaccaro, Christian Sandvig, Karrie Karahalios
Abstract
Interest has grown in designing algorithmic decision making systems for contestability. In this work, we study how users experience contesting unfavorable social media content moderation decisions. A large-scale online experiment tests whether different forms of appeals can improve users' experiences of automated decision making. We study the impact on users' perceptions of the Fairness, Accountability, and Trustworthiness of algorithmic decisions, as well as their feelings of Control (FACT). Surprisingly, we find that none of the appeal designs improve FACT perceptions compared to a no appeal baseline. We qualitatively analyze how users write appeals, and find that they contest the decision itself, but also more fundamental issues like the goal of moderating content, the idea of automation, and the inconsistency of the system as a whole. We conclude with suggestions for -- as well as a discussion of the challenges of -- designing for contestability.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers32
- Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and LaborShagun Jhaver, Alice Qian Zhang, Quan Ze Chen, Nikhila Natarajan et al.CSCW 2023 · 87 citations
- Contestability For Content ModerationKristen Vaccaro, Ziang Xiao, Kevin Hamilton, Karrie KarahaliosCSCW 2021 · 77 citations
- Comparing the Perceived Legitimacy of Content Moderation Processes: Contractors, Algorithms, Expert Panels, and Digital JuriesChristina A. Pan, Sahil Yakhmi, Tara P. Iyer, Evan Strasnick et al.CSCW 2022 · 68 citations
- Decolonizing Content Moderation: Does Uniform Global Community Standard Resemble Utopian Equality or Western Power Hegemony?Farhana Shahid, Aditya VashisthaCHI 2023 · 63 citations
- Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to DisputeKars Alfrink, Ianus Keller, Neelke Doorn, Gerd KortuemCHI 2023 · 44 citations
Related papers
- AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User AppealsShubham Atreja, Jane Im, Paul Resnick, Libby HemphillCSCW 2024 · 8 citations
- "I'm not sure what difference is between their content and mine, other than the person itself": A Study of Fairness Perception of Content Moderation on YouTubeRenkai Ma, Yubo KouCSCW 2022 · 42 citations
- Diametrically Opposed Attributes? Review Process Preferences and Priorities When Contesting Algorithmic DecisionsHenrietta Lyons, Tim Miller, Eduardo VellosoCSCW 2025 · 2 citations
- Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and ContestabilityMireia Yurrita, Tim Draws, Agathe Balayn, Dave Murray-Rust et al.CHI 2023 · 73 citations
- What's the Appeal? Perceptions of Review Processes for Algorithmic DecisionsHenrietta Lyons, Senuri Wijenayake, Tim Miller, Eduardo VellosoCHI 2022 · 26 citations
