Lune

EMNLP Findings2023

Mitigating Biases in Hate Speech Detection from A Causal Perspective

Zhehao Zhang, Jiaao Chen, Diyi Yang

Abstract

Warning: This paper discusses and contains offensive or upsetting content. Nowadays, many hate speech detectors are built to automatically detect hateful content. However, their training sets are sometimes skewed towards certain stereotypes (e.g., race or religion-related). As a result, the detectors are prone to depend on some shortcuts for predictions. Previous works mainly focus on token-level analysis and heavily rely on human experts' annotations to identify spurious correlations, which is not only costly but also incapable of discovering higherlevel artifacts. In this work, we use grammar induction to find grammar patterns for hate speech and analyze this phenomenon from a causal perspective. Concretely, we categorize and verify different biases based on their spuriousness and influence on the model prediction. Then, we propose two mitigation approaches including Multi-Task Intervention and Data-Specific Intervention based on these confounders. Experiments conducted on 9 hate speech datasets demonstrate the effectiveness of our approaches. The code is available at https://github. com/SALT-NLP/Bias_Hate_Causal.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 5 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers5

  1. What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot DetectionShangbin Feng, Herun Wan, Ningnan Wang, Zhaoxuan Tan et al.ACL 2024 · 19 citations
  2. Causality Guided Representation Learning for Cross-Style Hate Speech DetectionChengshuai Zhao, Shu Wan, Paras Sheth, Karan Patwa et al.WWW 2026
  3. ContiGuard: A Framework for Continual Toxicity Detection Against Evolving Evasive PerturbationsHankun Kang, Xin Miao, Jianhao Chen, Jintao Wen et al.WWW 2026
  4. Tracing Belief-Driven Thoughts with Theory-of-Mind Agents: An Opinion Analysis FrameworkJintao Wen, Yunfeng Ning, Hankun Kang, Xin Miao et al.WWW 2026
  5. Reinforcement Learning-Guided Adaptive Tuning for Out-of-Distribution Harmful Text DetectionMengyu Xiang, Tinghao Chen, Boxu Han, Qiudan Li et al.ACL 2026

Builds on23

  1. Investigating Gender Bias in Language Models Using Causal Mediation AnalysisJesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian et al.NeurIPS 2020 · 851 citations
  2. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsSamuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi et al.EMNLP Findings 2020 · 692 citations
  3. AEDA: An Easier Data Augmentation Technique for Text ClassificationAkbar Karimi, Leonardo Rossi, Andrea PratiEMNLP Findings 2021 · 166 citations
  4. Latent Hatred: A Benchmark for Understanding Implicit Hate SpeechMai ElSherief, Caleb Ziems, David Muchlinski, Vaishnavi Anupindi et al.EMNLP 2021 · 159 citations
  5. Reframing Instructional Prompts to GPTk's LanguageDaniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh HajishirziACL Findings 2022 · 126 citations

Related papers

  1. Uncovering the Root of Hate Speech: A Dataset for Identifying Hate Instigating SpeechHyoungjun Park, Ho Shim, Kyuhan LeeEMNLP Findings 2023 · 2 citations
  2. Dynamically Refined Regularization for Improving Cross-corpora Hate Speech DetectionTulika Bose, Nikolaos Aletras, Irina Illina, Dominique FohrACL Findings 2022 · 7 citations
  3. Delving into Qualitative Implications of Synthetic Data for Hate Speech DetectionCamilla Casula, Sebastiano Vecellio Salto, Alan Ramponi, Sara TonelliEMNLP 2024 · 1 citation
  4. Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?Yifan Wang, Mayank Jobanputra, Ji-Ung Lee, Soyoung Oh et al.ICLR 2026 · 3 citations
  5. Debiasing Algorithm through Model AdaptationTomasz Limisiewicz, David Marecek, Tomás MusilICLR 2024 · 24 citations
Dusk over the sea between two cliffs drawn in fine vertical lines