"Community Guidelines Make this the Best Party on the Internet": An In-Depth Study of Online Platforms' Content Moderation Policies
Brennan Schaffner, Arjun Nitin Bhagoji, Siyuan Cheng, Jacqueline Mei, Jay L. Shen, Grace Wang, Marshini Chetty, Nick Feamster, Genevieve Lakier, Chenhao Tan
Abstract
Moderating user-generated content on online platforms is crucial for balancing user safety and freedom of speech. Particularly in the United States, platforms are not subject to legal constraints prescribing permissible content. Each platform has thus developed bespoke content moderation policies, but there is little work towards a comparative understanding of these policies across platforms and topics. This paper presents the first systematic study of these policies from the 43 largest online platforms hosting user-generated content, focusing on policies around copyright infringement, harmful speech, and misleading content. We build a custom web-scraper to obtain policy text and develop a unified annotation scheme to analyze the text for the presence of critical components. We find significant structural and compositional variation in policies across topics and platforms, with some variation attributable to disparate legal groundings. We lay the groundwork for future studies of ever-evolving content moderation policies and their impact on users.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b3fcba6f-51bb-4728-9137-398cd9321838Cited by top-tier papers15
- Lost in Moderation: How Commercial Content Moderation APIs Over- and Under-Moderate Group-Targeted Hate Speech and Linguistic VariationsDavid Hartmann, Amin Oueslati, Dimitri Staufer, Lena Pohlmann et al.CHI 2025 · 37 citations
- Does Positive Reinforcement Work?: A Quasi-Experimental Study of the Effects of Positive Feedback on RedditCharlotte Lambert, Koustuv Saha, Eshwar ChandrasekharanCHI 2025 · 24 citations
- The Design Space for Online Restorative Justice Tools: A Case Study with ApoloBotBich Ngoc (Rubi) Doan, Joseph SeeringCHI 2025 · 7 citations
- Community Fact-Checks Trigger Moral Outrage in Replies to Misleading Posts on Social MediaYuwei Chuai, Anastasia Sergeeva, Gabriele Lenzini, Nicolas PröllochsCHI 2025 · 5 citations
- Governance of AI-Generated Content: A Case Study on Social Media PlatformsLan Gao, Abani Ahmed, Oscar Chen, Margaux Reyl et al.CHI 2026 · 3 citations
Builds on5
- Tranco: A Research-Oriented Top Sites Ranking Hardened Against ManipulationVictor Le Pochat, Tom van Goethem, Samaneh Tajalizadehkhoob, Maciej Korczynski et al.NDSS 2019 · 826 citations
- Evaluating the Effectiveness of Deplatforming as a Moderation Strategy on TwitterShagun Jhaver, Christian Boylston, Diyi Yang, Amy S. BruckmanCSCW 2021 · 168 citations
- Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/IncelsManoel Horta Ribeiro, Shagun Jhaver, Savvas Zannettou, Jeremy Blackburn et al.CSCW 2021 · 102 citations
- "At the End of the Day Facebook Does What ItWants": How Users Experience Contesting Algorithmic Content ModerationKristen Vaccaro, Christian Sandvig, Karrie KarahaliosCSCW 2020 · 79 citations
- Software-Supported Audits of Decision-Making Systems: Testing Google and Facebook's Political Advertising PoliciesJ. Nathan Matias, Austin Hounsel, Nick FeamsterCSCW 2022 · 17 citations
Related papers
- "I Cannot Write This Because It Violates Our Content Policy": Understanding Content Moderation Policies and User Experiences in Generative AI ProductsLan Gao, Oscar Chen, Rachel Lee, Nick Feamster et al.USENIX Security 2025
- Content Moderation and the Formation of Online Communities: A Theoretical FrameworkCynthia Dwork, Chris Hays, Jon M. Kleinberg, Manish RaghavanWWW 2024 · 7 citations
- User Attitudes to Content Moderation in Web SearchAleksandra Urman, Aniko Hannak, Mykola MakhortykhCSCW 2024 · 7 citations
- The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social MediaAmaury Trujillo, Tiziano Fagni, Stefano CresciCSCW 2025 · 16 citations
- Analyzing Ad Exposure and Content in Child-Oriented Videos on YouTubeEmaan Bilal Khan, Nida Tanveer, Aima Shahid, Mohammad Jaffer Iqbal et al.WWW 2024 · 7 citations
