ACL Findings2026
Auditing LLM Responses to Harmful Stereotypes Targeting Mental Health Groups
Arka Dutta, Rijul Magu, Sean Kim, Seohee Yoon, Munmun De Choudhury, Ashiqur R. KhudaBukhsh
Abstract
Large Language Models (LLMs) can exhibit imbalanced biases against vulnerable groups, but how they rationalize stereotypes and rights restrictions targeting mental health entities remains underexplored. We audit a broad suite of open-weight LLMs on stereotype-justification prompts tied to mental health identities. We find that several widely used models endorse harmful stereotypes when explicitly asked to justify them, with endorsement varying across model families, versions, and mental health conditions. We also show that widely used harmful-content evaluation and moderation frameworks often miss these nuanced, discriminatory responses, highlighting a gap in current AI safety evaluation for mental health groups.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on7
- Whose Opinions Do Language Models Reflect?Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee et al.ICML 2023 · 764 citations
- Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human SolutionsJiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G. Parker et al.CHI 2023 · 283 citations
- "Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference LettersYixin Wan, George Pu, Jiao Sun, Aparna Garimella et al.EMNLP Findings 2023 · 139 citations
- Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare QueriesYiqiao Jin, Mohit Chandra, Gaurav Verma, Yibo Hu et al.WWW 2024 · 126 citations
- Language (Technology) is Power: A Critical Survey of "Bias" in NLPSu Lin Blodgett, Solon Barocas, Hal Daumé III, Hanna M. WallachACL 2020 · 68 citations
Related papers
- LLMs Reproduce Stereotypes of Sexual and Gender MinoritiesRuby Ostrow, Adam LopezEMNLP Findings 2025 · 7 citations
- Rethinking Research on Stereotypes: An Analysis through Social Psychological and Computational PerspectivesKaustubh Shivshankar Shejole, Pushpak BhattacharyyaACL Findings 2026
- Gendered Mental Health Stigma in Masked Language ModelsInna W. Lin, Lucille Njoo, Anjalie Field, Ashish Sharma et al.EMNLP 2022 · 15 citations
- AccessEval: Benchmarking Disability Bias in Large Language ModelsSrikant Panda, Amit Agarwal, Hitesh Laxmichand PatelEMNLP 2025 · 2 citations
- A Conditional Companion: Lived Experiences of People with Mental Health Disorders Using LLMs: Conditional Companion: LLMs & Mental HealthAditya Kumar Purohit, Hendrik HeuerCHI 2026 · 3 citations
