Empowering Creators in the Fight Against Online Hate: A Qualitative Exploration of AI-Mediated Counterspeech Tools
Phoebe Yiqing Huang, Jiaming Deng, Yingchen Yang, Spencer Williams
Abstract
Content creators face heightened risks of online harm due to their public visibility and the increasing hostility in digital spaces. Traditional moderation tools, such as reporting and deletion, often fall short in addressing the emotional and reputational impact of online hate. In this study, we explore how community-driven approaches like counterspeech may support creators in navigating hateful comments, and how AI-powered tools could assist in this process. We conducted qualitative interviews and concept testing with 15 active content creators from Chinese social media platforms to understand their experiences and expectations. Our findings reveal that creators' approaches to counterspeech are shaped by their professional roles, the need to maintain authenticity, and the pressures of audience management. While creators saw value in AI-assisted counterspeech for improving efficiency and tone, they expressed concerns about misrepresentation, loss of control, and unintended harm. They preferred AI tools that augmented their voice rather than replaced it, and emphasized the importance of balancing emotional nuance with scalability. These insights inform the design of creator-centered AI moderation tools that integrate human agency and context sensitivity, contributing to healthier and more sustainable online environments.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 4bd0ecbb-89cf-4e0b-9b8c-e2b7a4cb926bRelated papers
- Counterspeakers' Perspectives: Unveiling Barriers and AI Needs in the Fight against Online HateJimin Mun, Cathy Buerger, Jenny T. Liang, Joshua Garland et al.CHI 2024 · 12 citations
- Perceiving and Countering Hate: The Role of Identity in Online ResponsesKaike Ping, James Hawdon, Eugenia Ha Rim RhoCSCW 2025 · 5 citations
- "It's common and a part of being a content creator": Understanding How Creators Experience and Cope with Hate and Harassment OnlineKurt Thomas, Patrick Gage Kelley, Sunny Consolvo, Patrawat Samermit et al.CHI 2022 · 63 citations
- Content Creation with Generative AI: How Do Content Creators Responsibly Use Generative AI Tools? CSCW009Jini Kim, Manqing Yu, Jiayin Zhi, Stephanie Milani et al.CSCW 2026
- Echoes of Norms: Investigating Counterspeech Bots' Influence on Bystanders in Online CommunitiesMengyao Wang, Shuai Ma, Nuo Li, Peng Zhang et al.CHI 2026 · 1 citation
