Skin-Deep Bias: How Avatar Appearances Shape Perceptions of AI Hiring
Ka Hei Carrie Lau, Philipp Stark, Efe Bozkir, Enkelejda Kasneci
Abstract
Artificial intelligence is increasingly used in hiring, raising concerns about how applicants perceive these systems. While prior work on algorithmic fairness has emphasized technical bias mitigation, little is known about how avatar identity cues influence applicants' justice attributions in an interview context. We conducted a crowdsourcing study with 215 participants who completed an interview with photorealistic AI avatars varied in phenotypic traits (race and sex), followed by a standardized rejection. Using self-reports, sentiment analysis, and eye tracking, we measured perceptions of trust, fairness, and bias. Results show that racial mismatch heightened perceptions of ethnic bias, while partial match (sharing only one identity) reduced fairness judgments compared to both full and no match. This work extends the Computers-Are-Social-Actors paradigm by demonstrating that avatar appearances shape justice-related evaluations of AI. We contribute to HCI by revealing how identity cues influence fairness attributions and offer actionable insights for designing equitable AI interview systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 86929762-c8ba-4b9a-a1fe-a0a093bd5107Builds on7
- Questioning the AI: Informing Design Practices for Explainable AI User ExperiencesQ. Vera Liao, Daniel M. Gruen, Sarah MillerCHI 2020 · 758 citations
- An Aligned Rank Transform Procedure for Multifactor Contrast TestsLisa A. Elkin, Matthew Kay, James J. Higgins, Jacob O. WobbrockUIST 2021 · 671 citations
- How WEIRD is CHI?Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau et al.CHI 2021 · 254 citations
- Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual DifferencesRuotong Wang, F. Maxwell Harper, Haiyi ZhuCHI 2020 · 209 citations
- Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature ReviewRock Yuren Pang, Hope Schroeder, Kynnedy Simone Smith, Solon Barocas et al.CHI 2025 · 51 citations
Related papers
- U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled InterviewsCassidy Pyle, Kat Roemmich, Nazanin AndalibiCSCW 2024 · 19 citations
- Lay Perceptions of Algorithmic Discrimination in the Context of Systemic InjusticeGabriel Lima, Nina Grgic-Hlaca, Markus Langer, Yixin ZouCHI 2025 · 6 citations
- "Finding the Magic Sauce": Exploring Perspectives of Recruiters and Job Seekers on Recruitment Bias and Automated ToolsMitra Lashkari, Jinghui ChengCHI 2023 · 14 citations
- Navigating Automated Hiring: Perceptions, Strategy Use, and Outcomes Among Young Job SeekersLena Armstrong, Danaé MetaxaCSCW 2025 · 7 citations
- Surveilling Suitability: How AI Hiring Interviews Impact Job Seekers with DisabilitiesVaishnav Kameswaran, Valentina Hong, Jazmin Clark, Yu Hou et al.CHI 2026 · 1 citation
