'There Has To Be a Lot That We're Missing': Moderating AI-Generated Content on Reddit
Travis Lloyd, Joseph Reagle, Mor Naaman
Abstract
Generative AI is altering how we work, learn, communicate, and participate in online communities. How might online communities be changed by generative AI? To start addressing this question, we focused on online community moderators' experiences with AI-generated content (AIGC). We performed fifteen indepth, semi-structured interviews with moderators of Reddit communities that restrict the use of AIGC. Our study finds that rules about AIGC are motivated by concerns about content quality, social dynamics, and governance challenges. Moderators fear that, without such rules, AIGC threatens to reduce their communities' utility and social value. We find that, despite the absence of robust tools for detecting AIGC, moderators were able to somewhat limit the disruption it caused by working with their communities to clarify norms. However, moderators found enforcing AIGC restrictions challenging, as they rely on time-intensive and inaccurate detection heuristics. Our results highlight the importance of supporting community autonomy and self-determination in the face of this sudden technological change, and suggest potential design solutions that may help.
CCS Concepts: • Human-centered computing → Empirical studies in collaborative and social computing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- AI Rules? Characterizing Reddit Community Policies Towards AI-Generated ContentTravis Lloyd, Jennah Gosciak, Tung Nguyen, Mor NaamanCHI 2025 · 25 citations
- Exploring the Use of Abusive Generative AI Models on CivitaiYiluo Wei, Yiming Zhu, Pan Hui, Gareth TysonACM MM 2024 · 11 citations
- Governance of AI-Generated Content: A Case Study on Social Media PlatformsLan Gao, Abani Ahmed, Oscar Chen, Margaux Reyl et al.CHI 2026 · 3 citations
- Beyond Community Notes: A Framework for Understanding and Building Crowdsourced Context Systems for Social MediaTravis Lloyd, Tung Nguyen, Karen Levy, Mor NaamanCHI 2026 · 2 citations
- PluRule: A Benchmark for Moderating Pluralistic Communities on Social MediaZoher Kachwala, Bao Tran Truong, Rasika Muralidharan, Haewoon Kwak et al.ACL 2026
Builds on24
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray et al.ICML 2021 · 6,356 citations
- Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray AreasOliver L. Haimson, Daniel Delmonaco, Peipei Nie, Andrea WegnerCSCW 2021 · 287 citations
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer ReviewsWeixin Liang, Zachary Izzo, Yaohui Zhang, Haley Lepp et al.ICML 2024 · 213 citations
- Reconsidering Self-Moderation: the Role of Research in Supporting Community-Based Models for Online Content ModerationJoseph SeeringCSCW 2020 · 151 citations
- "I run the world's largest historical outreach project and it's on a cesspool of a website." Moderating a Public Scholarship Site on Reddit: A Case Study of r/AskHistoriansSarah A. GilbertCSCW 2020 · 79 citations
Related papers
- Rule Development in Online Communities Amidst Growth and Generative AIAndy Zhao, Mor Naaman, Lancaster WuCSCW 2026
- "I Cannot Write This Because It Violates Our Content Policy": Understanding Content Moderation Policies and User Experiences in Generative AI ProductsLan Gao, Oscar Chen, Rachel Lee, Nick Feamster et al.USENIX Security 2025
- Exploring the Evolvement of User Engagement in Online Creative Community under the Surge of Generative AI: A Case Study of DeviantArtQingyu Guo, Yuqi Zhang, Kangyu Yuan, Changyang He et al.CSCW 2025
- Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal ImplicationsDilrukshi Gamage, Piyush Ghasiya, Vamshi Krishna Bonagiri, Mark E. Whiting et al.CHI 2022 · 77 citations
- Understanding the Impact of AI-Generated Content on Social Media: The Pixiv CaseYiluo Wei, Gareth TysonACM MM 2024 · 28 citations
