Take the Power Back: Screen-Based Personal Moderation Against Hate Speech on Instagram
Anna Ricarda Luther, Hendrik Heuer, Sebastian Haunss, Stephanie Geise, Andreas Breiter
Abstract
Hate speech remains a pressing challenge on social media, where platform moderation often fails to protect targeted users. Personal moderation tools that let users decide how content is filtered can address some of these shortcomings. However, it remains an open question on which screens (e.g., the comments, the reels tab, or the home feed) users want personal moderation and which features they value most. To address these gaps, we conducted a three-wave Delphi study with 40 activists who experienced hate speech. We combined quantitative ratings and rankings with open questions about required features. Participants prioritized personal moderation for conversational and algorithmically curated screens. They valued features allowing for reversibility and oversight across screens, while input-based, content-type specific, and highly automated features are more screen specific. We discuss the importance of personal moderation and offer user-centered design recommendations for personal moderation on Instagram.
• Human-centered computing → Empirical studies in collaborative and social computing; Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dbcdda8d-945c-4e88-8127-489c072cc066Builds on13
- "Go eat a bat, Chang!": On the Emergence of Sinophobic Behavior on Web Communities in the Face of COVID-19Fatemeh Tahmasbi, Leonard Schild, Chen Ling, Jeremy Blackburn et al.WWW 2021 · 92 citations
- Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and LaborShagun Jhaver, Alice Qian Zhang, Quan Ze Chen, Nikhila Natarajan et al.CSCW 2023 · 87 citations
- Designing Word Filter Tools for Creator-led Comment ModerationShagun Jhaver, Quan Ze Chen, Detlef Knauss, Amy X. ZhangCHI 2022 · 70 citations
- Sensemaking, Support, Safety, Retribution, Transformation: A Restorative Justice Approach to Understanding Adolescents' Needs for Addressing Online HarmSijia Xiao, Coye Cheshire, Niloufar SalehiCHI 2022 · 51 citations
- Lost in Moderation: How Commercial Content Moderation APIs Over- and Under-Moderate Group-Targeted Hate Speech and Linguistic VariationsDavid Hartmann, Amin Oueslati, Dimitri Staufer, Lena Pohlmann et al.CHI 2025 · 37 citations
Related papers
- "Ignorance is not Bliss": Designing Personalized Moderation to Address Ableist Hate on Social MediaSharon Heung, Lucy Jiang, Shiri Azenkot, Aditya VashisthaCHI 2025 · 14 citations
- Personalization up to a Point: Why Personalized Content Moderation Needs Boundaries, and How We Can Enforce ThemEmanuele Moscato, Tiancheng Hu, Matthias Orlikowski, Paul Röttger et al.EMNLP 2025
- "It's common and a part of being a content creator": Understanding How Creators Experience and Cope with Hate and Harassment OnlineKurt Thomas, Patrick Gage Kelley, Sunny Consolvo, Patrawat Samermit et al.CHI 2022 · 63 citations
- Why Social Media Users Press 'Not Interested': Motivations, Anticipated Effects, and Result InterpretationJihyeong Hong, Eun-Young Ko, Juho Kim, Jeong-woo JangCSCW 2025 · 3 citations
- Investigating Moderation Challenges to Combating Hate and Harassment: The Case of Mod-Admin Power Dynamics and Feature Misuse on RedditMadiha Tabassum, Alana Mackey, Ashley Schuett, Ada LernerUSENIX Security 2024 · 10 citations
