Participation and Division of Labor in User-Driven Algorithm Audits: How Do Everyday Users Work together to Surface Algorithmic Harms?
Rena Li, Sara Kingsley, Chelsea Fan, Proteeti Sinha, Nora Wai, Jaimie Lee, Hong Shen, Motahhare Eslami, Jason I. Hong
Abstract
Recent years have witnessed an interesting phenomenon in which users come together to interrogate potentially harmful algorithmic behaviors they encounter in their everyday lives. Researchers have started to develop theoretical and empirical understandings of these user-driven audits, with a hope to harness the power of users in detecting harmful machine behaviors. However, little is known about users' participation and their division of labor in these audits, which are essential to support these collective eorts in the future. Through collecting and analyzing 17,984 tweets from four recent cases of user-driven audits, we shed light on patterns of users' participation and engagement, especially with the top contributors in each case. We also identied the various roles users' generated content played in these audits, including hypothesizing, data collection, amplication, contextualization, and escalation. We discuss implications for designing tools to support user-driven audits and users who labor to raise awareness of algorithm bias.
• Human-centered computing ! Human computer interaction (HCI); Empirical studies in HCI .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
7 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AI cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
- WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AI cites Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior
- Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors cites Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic Resistance
- User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
- User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions cites The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships
- User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions cites Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior
- Let's Influence Algorithms Together: How Millions of Fans Build Collective Understanding of Algorithms and Organize Coordinated Algorithmic Actions cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
- Let's Influence Algorithms Together: How Millions of Fans Build Collective Understanding of Algorithms and Organize Coordinated Algorithmic Actions cites Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic Resistance
- Let's Influence Algorithms Together: How Millions of Fans Build Collective Understanding of Algorithms and Organize Coordinated Algorithmic Actions cites Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior
- Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
- Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior cites Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic Resistance
- Surfacing Problematic Recommender System Behaviors Affecting Music Discoverability: A Think-Aloud Protocol cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
- Surfacing Problematic Recommender System Behaviors Affecting Music Discoverability: A Think-Aloud Protocol cites Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior
Cited by top-tier papers7
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI RelationshipsRenwen Zhang, Han Li, Han Meng, Jinyuan Zhan et al.CHI 2025 · 122 citations
- Let's Influence Algorithms Together: How Millions of Fans Build Collective Understanding of Algorithms and Organize Coordinated Algorithmic ActionsQing Xiao, Yuhang Zheng, Xianzhe Fan, Bingbing Zhang et al.CHI 2025 · 16 citations
- User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI CompanionsXianzhe Fan, Qing Xiao, Xuhui Zhou, Jiaxin Pei et al.CHI 2025 · 15 citations
- WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AIWesley Hanwen Deng, Claire Wang, Howard Ziyu Han, Jason I. Hong et al.CSCW 2025 · 12 citations
- Surfacing Problematic Recommender System Behaviors Affecting Music Discoverability: A Think-Aloud ProtocolLorenzo Porcaro, Valeria Mirabella, Emilia Gómez, Tiziana CatarciCHI 2026 · 2 citations
Builds on11
- Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic ResistanceNadia Karizat, Daniel Delmonaco, Motahhare Eslami, Nazanin AndalibiCSCW 2021 · 338 citations
- Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic BehaviorsHong Shen, Alicia DeVos, Motahhare Eslami, Kenneth HolsteinCSCW 2021 · 156 citations
- "It's Complicated": Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and DisabilityCynthia L. Bennett, Cole Gleason, Morgan Klaus Scheuerman, Jeffrey P. Bigham et al.CHI 2021 · 125 citations
- Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behaviorAlicia DeVos, Aditi Dhabalia, Hong Shen, Kenneth Holstein et al.CHI 2022 · 96 citations
- ORES: Lowering Barriers with Participatory Machine Learning in WikipediaAaron Halfaker, R. Stuart GeigerCSCW 2020 · 84 citations
Related papers
- Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry PracticeWesley Hanwen Deng, Bill Boyuan Guo, Alicia DeVrio, Hong Shen et al.CHI 2023 · 73 citations
- Problematic Machine Behavior: A Systematic Literature Review of Algorithm AuditsJack BandyCSCW 2021 · 190 citations
- Learning AI Auditing: A Case Study of Teenagers Auditing a Generative AI ModelLuis Morales-Navarro, Michelle A. Gan, Evelyn Yu, Lauren Vogelstein et al.CSCW 2025 · 6 citations
- Having your Privacy Cake and Eating it Too: Platform-supported Auditing of Social Media Algorithms for Public InterestBasileal Imana, Aleksandra Korolova, John S. HeidemannCSCW 2023 · 18 citations
- Empowering Stakeholders with Participatory Auditing of Predictive AI: Perspectives from End-Users and Decision Subjects without AI ExpertisePatrizia Di Campli San Vito, Eva Fringi, Penny S. Johnston, Leonardo C. T. Bezerra et al.CHI 2026 · 3 citations
