Locating Risk: Task Designers and the Challenge of Risk Disclosure in Crowdsourced RAI Content Work CSCW029
Alice Qian, Ryland Shaw, Laura Dabbish, Jina Suh, Hong Shen
Abstract
As AI systems are increasingly tested and deployed in open-ended and high-stakes domains, crowdworkers are often tasked with responsible AI (RAI) content work. These tasks include labeling violent content, moderating disturbing text, or simulating harmful behavior for red teaming exercises to shape AI system behaviors. While prior research efforts have highlighted the risks to worker well-being associated with RAI content work, far less attention has been paid to how these risks are communicated to workers by task designers or individuals who design and post RAI tasks. Existing transparency frameworks and guidelines, such as model cards, datasheets, and crowdworksheets, focus on documenting model information and dataset collection processes, but they overlook an important aspect of disclosing well-being risks to workers. In the absence of standard workflows or clear guidance, the consistent application of content warnings, consent flows, or other forms of well-being risk disclosure remains unclear. This study investigates how task designers approach risk disclosure in crowdsourced RAI tasks. Drawing on interviews with 23 task designers across academic and industry sectors, we examine how well-being risk is recognized, interpreted, and communicated in practice. Our findings highlight the need to support task designers in identifying and communicating risks not only to support crowdworker well-being but also to strengthen the ethical integrity and technical efficacy of AI development pipelines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 528d19a1-7e11-43c1-a8dc-0b8d3d2fa418Cited by top-tier papers1
Ask how each one uses itBuilds on10
- "Everyone wants to do the model work, not the data work": Data Cascades in High-Stakes AINithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong et al.CHI 2021 · 725 citations
- The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving SupportMiriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl et al.CHI 2021 · 168 citations
- Quantifying the Invisible Labor in Crowd WorkCarlos Toxtli, Siddharth Suri, Saiph SavageCSCW 2021 · 91 citations
- Whose AI Dream? In search of the aspiration in data annotationDing Wang, Shantanu Prabhat, Nithya SambasivanCHI 2022 · 66 citations
- Feeling Proud, Feeling Embarrassed: Experiences of Low-income Women with Crowd WorkRama Adithya Varanasi, Divya Siddarth, Vivek Seshadri, Kalika Bali et al.CHI 2022 · 27 citations
Related papers
- AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content WorkAlice Qian Zhang, Judith Amores, Hong Shen, Mary Czerwinski et al.CSCW 2025 · 9 citations
- How Tech Workers Contend with Hazards of Humanlikeness in Generative AIMark Diaz, Renee Shelby, Eric Corbett, Andrew SmartCHI 2026 · 1 citation
- Guidelines for Integrating Value Sensitive Design in Responsible AI ToolkitsMalak Sadek, Marios Constantinides, Daniele Quercia, Céline MougenotCHI 2024 · 49 citations
- Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker PracticesXiaoyu Yang, Zelin Zhao, Weipeng Chen, Corey Kewei Xu et al.CHI 2026 · 1 citation
- AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design StagesMuzhe Wu, Yanzhi Zhao, Shuyi Han, Michael Xieyang Liu et al.CSCW 2026 · 1 citation
