No Easy Way Out: the Effectiveness of Deplatforming an Extremist Forum to Suppress Hate and Harassment
Anh V. Vu, Alice Hutchings, Ross J. Anderson
Abstract
Legislators and policymakers worldwide are debating options for suppressing illegal, harmful and undesirable material online. Drawing on several quantitative data sources, we show that deplatforming an active community to suppress online hate and harassment, even with a substantial concerted effort involving several tech firms, can be hard. Our case study is the disruption of the largest and longest-running harassment forum Kiwi Farms in late 2022, which is probably the most extensive industry effort to date. Despite the active participation of a number of tech companies over several consecutive months, this campaign failed to shut down the forum and remove its objectionable content. While briefly raising public awareness, it led to rapid platform displacement and traffic fragmentation. Part of the activity decamped to Telegram, while traffic shifted from the primary domain to previously abandoned alternatives. The forum experienced intermittent outages for several weeks, after which the community leading the campaign lost interest, traffic was directed back to the main domain, users quickly returned, and the forum was back online and became even more connected. The forum members themselves stopped discussing the incident shortly thereafter, and the net effect was that forum activity, active users, threads, posts and traffic were all cut by about half. The disruption largely affected casual users (of whom roughly 87% left), while half the core members remained engaged. It also drew many newcomers, who exhibited increasing levels of toxicity during the first few weeks of participation. Deplatforming a community without a court order raises philosophical issues about censorship versus free speech; ethical and legal issues about the role of industry in online content moderation; and practical issues on the efficacy of private-sector versus government action. Deplatforming a dispersed community using a series of court orders against individual service providers appears unlikely to be very effective if the censor cannot incapacitate the key maintainers, whether by arresting them, enjoining them or otherwise deterring them.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Deplatforming Norm-Violating Influencers on Social Media Reduces Overall Online Attention Toward ThemManoel Horta Ribeiro, Shagun Jhaver, Jordi Cluet-i-Martinell, Marie Reignier-Tayar et al.CSCW 2025 · 8 citations
- Formalizing Dependence of Web InfrastructureRumaisa Habib, Kimberly Ruth, Gautam Akiwate, Zakir DurumericSIGCOMM 2025 · 3 citations
- HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate CampaignsXinyue Shen, Yixin Wu, Yiting Qu, Michael Backes et al.USENIX Security 2025
- Chameleon Channels: Measuring YouTube Accounts Repurposed for Deception and ProfitAlejandro Cuevas, Manoel Horta Ribeiro, Nicolas ChristinUSENIX Security 2026
- Assessing the Aftermath: the Effects of a Global Takedown against DDoS-for-hire ServicesAnh V. Vu, Ben Collier, Daniel R. Thomas, John Kristoff et al.USENIX Security 2025
Builds on8
- SoK: Hate, Harassment, and the Changing Landscape of Online AbuseKurt Thomas, Devdatta Akhawe, Michael D. Bailey, Dan Boneh et al.S&P 2021 · 175 citations
- Evaluating the Effectiveness of Deplatforming as a Moderation Strategy on TwitterShagun Jhaver, Christian Boylston, Diyi Yang, Amy S. BruckmanCSCW 2021 · 168 citations
- Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/IncelsManoel Horta Ribeiro, Shagun Jhaver, Savvas Zannettou, Jeremy Blackburn et al.CSCW 2021 · 102 citations
- SoK: A Framework for Unifying At-Risk User ResearchNoel Warford, Tara Matthews, Kaitlyn Yang, Omer Akgul et al.S&P 2022 · 101 citations
- "It's common and a part of being a content creator": Understanding How Creators Experience and Cope with Hate and Harassment OnlineKurt Thomas, Patrick Gage Kelley, Sunny Consolvo, Patrawat Samermit et al.CHI 2022 · 63 citations
Related papers
- Stoking the Flames: Understanding Escalation in an Online Harassment CommunityKejsi Take, Victoria Zhong, Chris Geeng, Emmi Bevensee et al.CSCW 2024 · 4 citations
- Investigating Moderation Challenges to Combating Hate and Harassment: The Case of Mod-Admin Power Dynamics and Feature Misuse on RedditMadiha Tabassum, Alana Mackey, Ashley Schuett, Ada LernerUSENIX Security 2024 · 10 citations
- Content Moderation and Hate Speech on Alternative Platforms: A Case Study of BitChuteJacob Erickson, Bei YanCSCW 2025 · 5 citations
- Disinformation as Infrastructure: Making and Maintaining the QAnon Conspiracy on Italian Digital MediaIrene V. Pasquetto, Alberto F. Olivieri, Luca Tacchetti, Gianni Riotta et al.CSCW 2022 · 31 citations
- Platforms in Everything: Analyzing Ground-Truth Data on the Anatomy and Economics of Bullet-Proof HostingArman Noroozian, Jan Koenders, Eelco van Veldhuizen, Carlos Hernandez Gañán et al.USENIX Security 2019 · 40 citations
