Locating Risk: Task Designers and the Challenge of Risk Disclosure in Crowdsourced RAI Content Work CSCW029
Alice Qian, Ryland Shaw, Laura Dabbish, Jina Suh, Hong Shen
摘要
As AI systems are increasingly tested and deployed in open-ended and high-stakes domains, crowdworkers are often tasked with responsible AI (RAI) content work. These tasks include labeling violent content, moderating disturbing text, or simulating harmful behavior for red teaming exercises to shape AI system behaviors. While prior research efforts have highlighted the risks to worker well-being associated with RAI content work, far less attention has been paid to how these risks are communicated to workers by task designers or individuals who design and post RAI tasks. Existing transparency frameworks and guidelines, such as model cards, datasheets, and crowdworksheets, focus on documenting model information and dataset collection processes, but they overlook an important aspect of disclosing well-being risks to workers. In the absence of standard workflows or clear guidance, the consistent application of content warnings, consent flows, or other forms of well-being risk disclosure remains unclear. This study investigates how task designers approach risk disclosure in crowdsourced RAI tasks. Drawing on interviews with 23 task designers across academic and industry sectors, we examine how well-being risk is recognized, interpreted, and communicated in practice. Our findings highlight the need to support task designers in identifying and communicating risks not only to support crowdworker well-being but also to strengthen the ethical integrity and technical efficacy of AI development pipelines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper10
- "Everyone wants to do the model work, not the data work": Data Cascades in High-Stakes AINithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong 等CHI 2021 · 被引用 725 次
- The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving SupportMiriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl 等CHI 2021 · 被引用 168 次
- Quantifying the Invisible Labor in Crowd WorkCarlos Toxtli, Siddharth Suri, Saiph SavageCSCW 2021 · 被引用 91 次
- Whose AI Dream? In search of the aspiration in data annotationDing Wang, Shantanu Prabhat, Nithya SambasivanCHI 2022 · 被引用 66 次
- Feeling Proud, Feeling Embarrassed: Experiences of Low-income Women with Crowd WorkRama Adithya Varanasi, Divya Siddarth, Vivek Seshadri, Kalika Bali 等CHI 2022 · 被引用 27 次
相关 Paper
- AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content WorkAlice Qian Zhang, Judith Amores, Hong Shen, Mary Czerwinski 等CSCW 2025 · 被引用 9 次
- How Tech Workers Contend with Hazards of Humanlikeness in Generative AIMark Diaz, Renee Shelby, Eric Corbett, Andrew SmartCHI 2026 · 被引用 1 次
- Guidelines for Integrating Value Sensitive Design in Responsible AI ToolkitsMalak Sadek, Marios Constantinides, Daniele Quercia, Céline MougenotCHI 2024 · 被引用 49 次
- Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker PracticesXiaoyu Yang, Zelin Zhao, Weipeng Chen, Corey Kewei Xu 等CHI 2026 · 被引用 1 次
- AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design StagesMuzhe Wu, Yanzhi Zhao, Shuyi Han, Michael Xieyang Liu 等CSCW 2026 · 被引用 1 次
