Lune

CSCW2025Top-tier venue

Learning AI Auditing: A Case Study of Teenagers Auditing a Generative AI Model

Luis Morales-Navarro, Michelle A. Gan, Evelyn Yu, Lauren Vogelstein, Yasmin B. Kafai, Danaé Metaxa

Abstract

This study investigates how high school-aged youth engage in algorithm auditing to identify and understand biases in artificial intelligence and machine learning (AI/ML) tools they encounter daily. With AI/ML technologies being increasingly integrated into young people's lives, there is an urgent need to equip teenagers with AI literacies that build both technical knowledge and awareness of social impacts. Algorithm audits (also called AI audits) have traditionally been employed by experts to assess potential harmful biases, but recent research suggests that non-expert users can also participate productively in auditing. We conducted a two-week participatory design workshop with 14 teenagers (ages 14-15), where they audited the generative AI model behind TikTok's Effect House, a tool for creating interactive TikTok filters. We present a case study describing how teenagers approached the audit, from deciding what to audit to analyzing data using diverse strategies and communicating their results. Our findings show that participants were engaged and creative throughout the activities, independently raising and exploring new considerations, such as age-related biases, that are uncommon in professional audits. We drew on our expertise in algorithm auditing to triangulate their findings as a way to examine if the workshop supported participants to reach coherent conclusions in their audit. Although the resulting number of changes in race, gender, and age representation uncovered by the teens were slightly different from ours, we reached similar conclusions. This study highlights the potential for auditing to inspire learning activities to foster AI literacies, empower teenagers to critically examine AI systems, and contribute fresh perspectives to the study of algorithmic harms.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors cites Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic Resistance
  • Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior cites Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors
  • Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior cites Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic Resistance
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on14

  1. What is AI Literacy? Competencies and Design ConsiderationsDuri Long, Brian MagerkoCHI 2020 · 2,947 citations
  2. Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic ResistanceNadia Karizat, Daniel Delmonaco, Motahhare Eslami, Nazanin AndalibiCSCW 2021 · 338 citations
  3. Problematic Machine Behavior: A Systematic Literature Review of Algorithm AuditsJack BandyCSCW 2021 · 190 citations
  4. Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic BehaviorsHong Shen, Alicia DeVos, Motahhare Eslami, Kenneth HolsteinCSCW 2021 · 156 citations
  5. Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behaviorAlicia DeVos, Aditi Dhabalia, Hong Shen, Kenneth Holstein et al.CHI 2022 · 96 citations

Related papers

  1. Sensemaking in User-Driven Algorithm Auditing: A Case Study on Gender Bias in an Image Captioning ModelBehnoosh Mohammadzadeh, Jules Françoise, Michèle Gouiffès, Baptiste CaramiauxCHI 2026 · 1 citation
  2. Informal Embodied Auditing: Exploring Facial Emotion AI (FEAI) through Community WorkshopsXingyu Li, Alexandra Teixeira Riggs, Zhiming Dai, Crystal Byrd Farmer et al.CHI 2026 · 2 citations
  3. The Potential of Diverse Youth as Stakeholders in Identifying and Mitigating Algorithmic Bias for a Future of Fairer AIJaemarie Solyst, Ellia Yang, Shixian Xie, Amy Ogan et al.CSCW 2023 · 66 citations
  4. WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AIWesley Hanwen Deng, Claire Wang, Howard Ziyu Han, Jason I. Hong et al.CSCW 2025 · 12 citations
  5. BiasViz: A Project-Based, Narrative-Centered Learning Tool for Engaging Middle School Students in Critical Thinking about AI BiasesHasti Darabipourshiraz, Daria Smyslova, Dongkuan Xu, Shiyan Jiang et al.CHI 2026 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines