Lune

CSCW2021Top-tier venue

Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits

Jack Bandy

Abstract

While algorithm audits are growing rapidly in commonality and public importance, relatively little scholarly work has gone toward synthesizing prior work and strategizing future research in the area. This systematic literature review aims to do just that, following PRISMA guidelines in a review of over 500 English articles that yielded 62 algorithm audit studies. The studies are synthesized and organized primarily by behavior (discrimination, distortion, exploitation, and misjudgement), with codes also provided for domain (e.g. search, vision, advertising, etc.), organization (e.g. Google, Facebook, Amazon, etc.), and audit method (e.g. sock puppet, direct scrape, crowdsourcing, etc.). The review shows how previous audit studies have exposed public-facing algorithms exhibiting problematic behavior, such as search algorithms culpable of distortion and advertising algorithms culpable of discrimination. Based on the studies reviewed, it also suggests some behaviors (e.g. discrimination on the basis of intersectional identities), domains (e.g. advertising algorithms), methods (e.g. code auditing), and organizations (e.g. Twitter, TikTok, LinkedIn) that call for future audit attention. The paper concludes by offering the common ingredients of successful audits, and discussing algorithm auditing in the context of broader research working toward algorithmic justice.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

25 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • End-User Audits: A System Empowering Communities to Lead Large-Scale Investigations of Harmful Algorithmic Behavior cites Facebook Ads Monitor: An Independent Auditing System for Political Ads on Facebook
  • End-User Audits: A System Empowering Communities to Lead Large-Scale Investigations of Harmful Algorithmic Behavior cites Critical Race Theory for HCI
  • Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling cites Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising
  • Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising cites End-User Audits: A System Empowering Communities to Lead Large-Scale Investigations of Harmful Algorithmic Behavior
  • Facebook Ads Monitor: An Independent Auditing System for Political Ads on Facebook cites Unveiling and Quantifying Facebook Exploitation of Sensitive Personal Data for Advertising Purposes
  • An Empirical Investigation of Personalization Factors on TikTok cites Measuring Misinformation in Video Search Platforms: An Audit Study on YouTube
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers25

  1. An Empirical Investigation of Personalization Factors on TikTokMaximilian Boeker, Aleksandra UrmanWWW 2022 · 112 citations
  2. End-User Audits: A System Empowering Communities to Lead Large-Scale Investigations of Harmful Algorithmic BehaviorMichelle S. Lam, Mitchell L. Gordon, Danaë Metaxa, Jeffrey T. Hancock et al.CSCW 2022 · 77 citations
  3. Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit ToolingVictor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane et al.CHI 2025 · 46 citations
  4. Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted AdvertisingMichelle S. Lam, Ayush Pandit, Colin H. Kalicki, Rachit Gupta et al.CSCW 2023 · 40 citations
  5. Lost in Moderation: How Commercial Content Moderation APIs Over- and Under-Moderate Group-Targeted Hate Speech and Linguistic VariationsDavid Hartmann, Amin Oueslati, Dimitri Staufer, Lena Pohlmann et al.CHI 2025 · 37 citations

Builds on7

  1. Critical Race Theory for HCIIhudiya Finda Ogbonnaya-Ogburu, Angela D. R. Smith, Alexandra To, Kentaro ToyamaCHI 2020 · 397 citations
  2. Measuring Misinformation in Video Search Platforms: An Audit Study on YouTubeEslam Hussein, Prerna Juneja, Tanushree MitraCSCW 2020 · 233 citations
  3. Face Flashing: a Secure Liveness Detection Protocol based on Light ReflectionsDi Tang, Zhe Zhou, Yinqian Zhang, Kehuan ZhangNDSS 2018 · 78 citations
  4. Facebook Ads Monitor: An Independent Auditing System for Political Ads on FacebookMárcio Silva, Lucas Santos de Oliveira, Athanasios Andreou, Pedro Olmo Stancioli Vaz de Melo et al.WWW 2020 · 71 citations
  5. Unveiling and Quantifying Facebook Exploitation of Sensitive Personal Data for Advertising PurposesJosé González Cabañas, Ángel Cuevas, Rubén CuevasUSENIX Security 2018 · 54 citations

Related papers

  1. Auditing for Discrimination in Algorithms Delivering Job AdsBasileal Imana, Aleksandra Korolova, John S. HeidemannWWW 2021 · 105 citations
  2. Beyond the Checkbox: Strengthening DSA Compliance Through Social Media Algorithmic AuditingSara Solarova, Matús Mesarcík, Branislav Pecher, Ivan SrbaCHI 2026 · 2 citations
  3. Software-Supported Audits of Decision-Making Systems: Testing Google and Facebook's Political Advertising PoliciesJ. Nathan Matias, Austin Hounsel, Nick FeamsterCSCW 2022 · 17 citations
  4. Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behaviorAlicia DeVos, Aditi Dhabalia, Hong Shen, Kenneth Holstein et al.CHI 2022 · 96 citations
  5. Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic BehaviorsHong Shen, Alicia DeVos, Motahhare Eslami, Kenneth HolsteinCSCW 2021 · 156 citations
Dusk over the sea between two cliffs drawn in fine vertical lines