From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorders
Amy A. Winecoff, Kevin Klyman
Abstract
Generative AI systems may pose serious risks to individuals vulnerable to eating disorders. Existing safeguards tend to overlook subtle but clinically significant cues, leaving many risks unaddressed. To better understand the nature of these risks, we conducted semi-structured interviews with 15 clinicians, researchers, and advocates with expertise in eating disorders. Using abductive qualitative analysis, we developed an expert-guided taxonomy of generative AI risks across seven categories: ( 1) providing generalized health advice; (2) encouraging disordered behaviors; (3) supporting symptom concealment; (4) creating thinspiration; (5) reinforcing negative self-beliefs; (6) promoting excessive focus on the body; and (7) perpetuating narrow views about eating disorders. Our results demonstrate how certain user interactions with generative AI systems intersect with clinical features of eating disorders in ways that may intensify risk. We discuss implications of our work, including approaches for risk assessment, safeguard design, and participatory evaluation practices with domain experts. CCS Concepts: • Human-centered computing → Empirical studies in collaborative and social computing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 38e51c8a-4d09-4fbb-8840-c0e7db34025eBuilds on9
- Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen et al.ICLR 2024 · 1,104 citations
- Towards Understanding Sycophancy in Language ModelsMrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud et al.ICLR 2024 · 762 citations
- Conformity of Eating Disorders through Content ModerationJessica L. Feuston, Alex S. Taylor, Anne Marie PiperCSCW 2020 · 82 citations
- Automated Emotion Recognition in the Workplace: How Proposed Technologies Reveal Potential Futures of WorkKaren L. Boyd, Nazanin AndalibiCSCW 2023 · 61 citations
- The Distressing Ads That Persist: Uncovering The Harms of Targeted Weight-Loss Ads Among Users with Histories of Disordered EatingLiza Gak, Seyi Olojo, Niloufar SalehiCSCW 2022 · 31 citations
Related papers
- A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public HealthJiawei Zhou, Amy Z. Chen, Darshi Shah, Laura Schwab Reese et al.CSCW 2025 · 6 citations
- Principles of Safe AI Companions for Youth: Parent and Expert PerspectivesYaman Yu, Mohi, Aishi Debroy, Xin Cao et al.CHI 2026 · 3 citations
- Privacy and Safety Experiences and Concerns of US Women Using Generative AI for Seeking Sexual and Reproductive Health InformationIna Kaleva, Xiao Zhan, Ruba Abu-Salma, Jose SuchCHI 2026 · 1 citation
- Responsible Evaluation of AI for Mental HealthHiba Arnaout, Anmol Goel, H. Andrew Schwartz, Steffen Eberhardt et al.ACL 2026
- "Can LLMs Persuade Humans with Deception?": From a Deceptive Strategy Taxonomy to a Large-Scale Empirical StudyHaein Yeo, Seungwan Jin, Taehyung Noh, Yejin Shin et al.CHI 2026 · 2 citations
