AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content Work
Alice Qian Zhang, Judith Amores, Hong Shen, Mary Czerwinski, Mary L. Gray, Jina Suh
Abstract
Behind the scenes of maintaining the safety of technology products from harmful and illegal digital content lies unrecognized human labor. The recent rise in the use of generative AI technologies and the accelerating demands to meet responsible AI (RAI) aims necessitates an increased focus on the labor behind such efforts in the age of AI. This study investigates the nature and challenges of content work that supports RAI efforts, or "RAI content work," that spans content moderation, data labeling, and red teaming -- through the lived experiences of content workers. We conduct a formative survey and semi-structured interview studies to develop a conceptualization of RAI content work and a subsequent framework of recommendations for providing holistic support for content workers. We validate our recommendations through a series of workshops with content workers and derive considerations for and examples of implementing such recommendations. We discuss how our framework may guide future innovation to support the well-being and professional development of the RAI content workforce.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bd8651bf-d0b3-4a55-b040-f97a33ee8ee9Cited by top-tier papers7
- AI on My Shoulder: Supporting Emotional Labor in Front-Office Roles with an LLM-based Empathetic CoworkerVedant Das Swain, Qiuyue Joy Zhong, Jash Rajesh Parekh, Yechan Jeon et al.CHI 2025 · 22 citations
- Dark and Bright Side of Participatory Red-Teaming with Targets of Stereotyping for Eliciting Harmful Behaviors from Large Language ModelsSieun Kim, Yeeun Jo, Sungmin Na, Hyunseung Lim et al.CHI 2026 · 2 citations
- Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content WorkAlice Qian, Ziqi Yang, Ryland Shaw, Jina Suh et al.CHI 2026 · 1 citation
- Labor, Capital, and Machine: Toward a Labor Process Theory for HCIYigang Qin, EunJeong CheonCHI 2026 · 1 citation
- Locating Risk: Task Designers and the Challenge of Risk Disclosure in Crowdsourced RAI Content Work CSCW029Alice Qian, Ryland Shaw, Laura Dabbish, Jina Suh et al.CSCW 2026
Builds on11
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust RefusalMantas Mazeika, Long Phan, Xuwang Yin, Andy Zou et al.ICML 2024 · 1,031 citations
- Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AIMichael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, Hanna M. WallachCHI 2020 · 428 citations
- Red Teaming Language Models with Language ModelsEthan Perez, Saffron Huang, H. Francis Song, Trevor Cai et al.EMNLP 2022 · 239 citations
- The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving SupportMiriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl et al.CHI 2021 · 168 citations
- Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and LaborShagun Jhaver, Alice Qian Zhang, Quan Ze Chen, Nikhila Natarajan et al.CSCW 2023 · 87 citations
Related papers
- How Tech Workers Contend with Hazards of Humanlikeness in Generative AIMark Diaz, Renee Shelby, Eric Corbett, Andrew SmartCHI 2026 · 1 citation
- Content Creation with Generative AI: How Do Content Creators Responsibly Use Generative AI Tools? CSCW009Jini Kim, Manqing Yu, Jiayin Zhi, Stephanie Milani et al.CSCW 2026
- Who Gets to Define Safety? A Systematic Review of How Generative AI Research Addresses Youth Online SafetyOzioma Collins Oguine, Adriana Alvarado Garcia, Michael J. Muller, Karla Badillo-UrquiolaCHI 2026 · 2 citations
- Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices For Generative AIBixuan Ren, Eunjeong Cheon, Jianghui LiCSCW 2025 · 3 citations
- Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker PracticesXiaoyu Yang, Zelin Zhao, Weipeng Chen, Corey Kewei Xu et al.CHI 2026 · 1 citation
