"Short is the Road that Leads from Fear to Hate": Fear Speech in Indian WhatsApp Groups
Punyajoy Saha, Binny Mathew, Kiran Garimella, Animesh Mukherjee
Abstract
WhatsApp is the most popular messaging app in the world. Due to its popularity, WhatsApp has become a powerful and cheap tool for political campaigning being widely used during the 2019 Indian general election, where it was used to connect to the voters on a large scale. Along with the campaigning, there have been reports that WhatsApp has also become a breeding ground for harmful speech against various protected groups and religious minorities. Many such messages attempt to instil fear among the population about a specific (minority) community. According to research on inter-group conflict, such 'fear speech' messages could have a lasting impact and might lead to real offline violence. In this paper, we perform the first large scale study on fear speech across thousands of public WhatsApp groups discussing politics in India. We curate a new dataset and try to characterize fear speech from this dataset. We observe that users writing fear speech messages use various events and symbols to create the illusion of fear among the reader about a target community. We build models to classify fear speech and observe that current state-of-the-art NLP models do not perform well at this task. Fear speech messages tend to spread faster and could potentially go undetected by classifiers built to detect traditional toxic speech due to their low toxic nature. Finally, using a novel methodology to target users with Facebook ads, we conduct a survey among the users of these WhatsApp groups to understand the types of users who consume and share fear speech. We believe that this work opens up new research questions that are very different from tackling hate speech which the research community has been traditionally involved in. We have made our code and dataset public 1 for other researchers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 89c80635-5308-4603-b348-30c6b7740e34Cited by top-tier papers10
- ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Detection in Conversational AIAmanda Cercas Curry, Gavin Abercrombie, Verena RieserEMNLP 2021 · 38 citations
- The Virality of Hate Speech on Social MediaAbdurahman Maarouf, Nicolas Pröllochs, Stefan FeuerriegelCSCW 2024 · 33 citations
- The Politics of Fear and the Experience of Bangladeshi Religious Minority Communities Using Social Media PlatformsMohammad Rashidujjaman Rifat, Dipto Das, Arpon Podder, Mahiratul Jannat et al.CSCW 2024 · 12 citations
- Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is OffensiveTharindu Cyril Weerasooriya, Sujan Dutta, Tharindu Ranasinghe, Marcos Zampieri et al.EMNLP 2023 · 12 citations
- Investigating Nudges toward Related Sellers on E-commerce Marketplaces: A Case Study on AmazonAbhisek Dash, Abhijnan Chakraborty, Saptarshi Ghosh, Animesh Mukherjee et al.CSCW 2024 · 4 citations
Builds on2
Related papers
- Trend Alert: A Cross-Platform Organization Manipulated Twitter Trends in the Indian General ElectionMaurice Jakesch, Kiran Garimella, Dean Eckles, Mor NaamanCSCW 2021 · 46 citations
- Misinformation as a Window into Prejudice: COVID-19 and the Information Environment in IndiaSyeda Zainab Akbar, Anmol Panda, Divyanshu Kukreti, Azhagu Meena et al.CSCW 2020 · 44 citations
- Topical Focus of Political Campaigns and its Impact: Findings from Politicians' Hashtag Use during the 2019 Indian ElectionsAnmol Panda, Ramaravind Kommiya Mothilal, Monojit Choudhury, Kalika Bali et al.CSCW 2020 · 16 citations
- HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate CampaignsXinyue Shen, Yixin Wu, Yiting Qu, Michael Backes et al.USENIX Security 2025
- Jettisoning Junk Messaging in the Era of End-to-End Encryption: A Case Study of WhatsAppPushkal Agarwal, Aravindh Raman, Damilola Ibosiola, Nishanth Sastry et al.WWW 2022 · 3 citations
