Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content Work
Alice Qian, Ziqi Yang, Ryland Shaw, Jina Suh, Laura Dabbish, Hong Shen
Abstract
Responsible AI (RAI) content work, such as annotation, moderation, or red teaming for AI safety, often exposes crowd workers to potentially harmful content. While prior work has underscored the importance of communicating well-being risk to employed content moderators, designing effective disclosure mechanisms for crowd workers while balancing worker protection with the needs of task designers and platforms remains largely unexamined. To address this gap, we conducted individual co-design sessions with 15 task designers, 11 crowdworkers, and 3 platform representatives. We investigated task designer preferences for support in disclosing tasks, worker preferences for receiving risk disclosure warnings, and how platform representatives envision their role in shaping risk disclosure practices. We identify design tensions and map the sociotechnical tradeoffs that shape disclosure practices. We contribute design recommendations and feature concepts for risk disclosure mechanisms in the context of RAI content work.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 836d2a1b-ce33-4f93-b1f4-28b4861ffc96Builds on12
- The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving SupportMiriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl et al.CHI 2021 · 168 citations
- Quantifying the Invisible Labor in Crowd WorkCarlos Toxtli, Siddharth Suri, Saiph SavageCSCW 2021 · 91 citations
- Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and LaborShagun Jhaver, Alice Qian Zhang, Quan Ze Chen, Nikhila Natarajan et al.CSCW 2023 · 87 citations
- Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless ServicesTzu-Sheng Kuo, Hong Shen, Jisoo Geum, Nev Jones et al.CHI 2023 · 82 citations
- Designing Word Filter Tools for Creator-led Comment ModerationShagun Jhaver, Quan Ze Chen, Detlef Knauss, Amy X. ZhangCHI 2022 · 70 citations
Related papers
- Locating Risk: Task Designers and the Challenge of Risk Disclosure in Crowdsourced RAI Content Work CSCW029Alice Qian, Ryland Shaw, Laura Dabbish, Jina Suh et al.CSCW 2026
- AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content WorkAlice Qian Zhang, Judith Amores, Hong Shen, Mary Czerwinski et al.CSCW 2025 · 9 citations
- Content Creation with Generative AI: How Do Content Creators Responsibly Use Generative AI Tools? CSCW009Jini Kim, Manqing Yu, Jiayin Zhi, Stephanie Milani et al.CSCW 2026
- Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker PracticesXiaoyu Yang, Zelin Zhao, Weipeng Chen, Corey Kewei Xu et al.CHI 2026 · 1 citation
- How Tech Workers Contend with Hazards of Humanlikeness in Generative AIMark Diaz, Renee Shelby, Eric Corbett, Andrew SmartCHI 2026 · 1 citation
