EMNLP Findings2023
Mitigating Biases in Hate Speech Detection from A Causal Perspective
Zhehao Zhang, Jiaao Chen, Diyi Yang
Abstract
Warning: This paper discusses and contains offensive or upsetting content. Nowadays, many hate speech detectors are built to automatically detect hateful content. However, their training sets are sometimes skewed towards certain stereotypes (e.g., race or religion-related). As a result, the detectors are prone to depend on some shortcuts for predictions. Previous works mainly focus on token-level analysis and heavily rely on human experts' annotations to identify spurious correlations, which is not only costly but also incapable of discovering higherlevel artifacts. In this work, we use grammar induction to find grammar patterns for hate speech and analyze this phenomenon from a causal perspective. Concretely, we categorize and verify different biases based on their spuriousness and influence on the model prediction. Then, we propose two mitigation approaches including Multi-Task Intervention and Data-Specific Intervention based on these confounders. Experiments conducted on 9 hate speech datasets demonstrate the effectiveness of our approaches. The code is available at https://github. com/SALT-NLP/Bias_Hate_Causal.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 5 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers5
- What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot DetectionShangbin Feng, Herun Wan, Ningnan Wang, Zhaoxuan Tan et al.ACL 2024 · 19 citations
- Causality Guided Representation Learning for Cross-Style Hate Speech DetectionChengshuai Zhao, Shu Wan, Paras Sheth, Karan Patwa et al.WWW 2026
- ContiGuard: A Framework for Continual Toxicity Detection Against Evolving Evasive PerturbationsHankun Kang, Xin Miao, Jianhao Chen, Jintao Wen et al.WWW 2026
- Tracing Belief-Driven Thoughts with Theory-of-Mind Agents: An Opinion Analysis FrameworkJintao Wen, Yunfeng Ning, Hankun Kang, Xin Miao et al.WWW 2026
- Reinforcement Learning-Guided Adaptive Tuning for Out-of-Distribution Harmful Text DetectionMengyu Xiang, Tinghao Chen, Boxu Han, Qiudan Li et al.ACL 2026
Builds on23
- Investigating Gender Bias in Language Models Using Causal Mediation AnalysisJesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian et al.NeurIPS 2020 · 851 citations
- RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsSamuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi et al.EMNLP Findings 2020 · 692 citations
- AEDA: An Easier Data Augmentation Technique for Text ClassificationAkbar Karimi, Leonardo Rossi, Andrea PratiEMNLP Findings 2021 · 166 citations
- Latent Hatred: A Benchmark for Understanding Implicit Hate SpeechMai ElSherief, Caleb Ziems, David Muchlinski, Vaishnavi Anupindi et al.EMNLP 2021 · 159 citations
- Reframing Instructional Prompts to GPTk's LanguageDaniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh HajishirziACL Findings 2022 · 126 citations
Related papers
- Uncovering the Root of Hate Speech: A Dataset for Identifying Hate Instigating SpeechHyoungjun Park, Ho Shim, Kyuhan LeeEMNLP Findings 2023 · 2 citations
- Dynamically Refined Regularization for Improving Cross-corpora Hate Speech DetectionTulika Bose, Nikolaos Aletras, Irina Illina, Dominique FohrACL Findings 2022 · 7 citations
- Delving into Qualitative Implications of Synthetic Data for Hate Speech DetectionCamilla Casula, Sebastiano Vecellio Salto, Alan Ramponi, Sara TonelliEMNLP 2024 · 1 citation
- Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?Yifan Wang, Mayank Jobanputra, Ji-Ung Lee, Soyoung Oh et al.ICLR 2026 · 3 citations
- Debiasing Algorithm through Model AdaptationTomasz Limisiewicz, David Marecek, Tomás MusilICLR 2024 · 24 citations
