Lune

ACL Findings2023

With Prejudice to None: A Few-Shot, Multilingual Transfer Learning Approach to Detect Social Bias in Low Resource Languages

Nihar Sahoo, Niteesh Mallela, Pushpak Bhattacharyya

Abstract

Warning: This paper contains offensive material by way of examples and case studies which is unavoidable due to the nature of the work.

In this paper, we describe our work on social bias detection in a low-resource multilingual setting in which the languages are from two very divergent families-Indo-European (English, Hindi, and Italian) and Altaic (Korean). Currently, the majority of the social bias datasets available are in English and this inhibits progress on social bias detection in lowresource languages. To address this problem, we introduce a new dataset for social bias detection in Hindi and investigate multilingual transfer learning using publicly available English, Italian, and Korean datasets. The Hindi dataset contains ∼ 9𝑘 social media posts annotated for (i) binary bias labels (bias/neutral), (ii) binary labels for sentiment (positive/negative), (iii) target groups for each bias category, and (iv) rationale for annotated bias labels (a short piece of text). We benchmark our Hindi dataset using different multilingual models, with XLM-R achieving the best performance of 80.8 macro-F1 score. Our results show that the detection of social biases in resource-constrained languages such as Hindi and Korean may be improved with the use of a similar dataset in English. We also show that translating all datasets into English does not work effectively for detecting social bias, since the nuances of source language are lost in translation.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • A Multilingual Social Bias Benchmark Incorporating Thinking Processes cites Social Bias Frames: Reasoning about Social and Power Implications of Language
  • A Multilingual Social Bias Benchmark Incorporating Thinking Processes cites CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
  • Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages cites Unsupervised Cross-lingual Representation Learning at Scale
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. A Multilingual Social Bias Benchmark Incorporating Thinking ProcessesMasahiro Kaneko, Danushka Bollegala, Timothy BaldwinACL 2026

Builds on7

  1. Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
  2. Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified FrameworkZirui Wang, Jiateng Xie, Ruochen Xu, Yiming Yang et al.ICLR 2020 · 84 citations
  3. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language ModelsNikita Nangia, Clara Vania, Rasika Bhalerao, Samuel R. BowmanEMNLP 2020 · 19 citations
  4. Social Bias Frames: Reasoning about Social and Power Implications of LanguageMaarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky et al.ACL 2020 · 16 citations
  5. Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced LanguagesPaul Röttger, Debora Nozza, Federico Bianchi, Dirk HovyEMNLP 2022 · 16 citations

Related papers

  1. Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social MediaShubham Mittal, Megha Sundriyal, Preslav NakovEMNLP 2023 · 4 citations
  2. Cross-lingual Transfer Can Worsen Bias in Sentiment AnalysisSeraphina Goldfarb-Tarrant, Björn Ross, Adam LopezEMNLP 2023 · 4 citations
  3. Target-Oriented Relation Alignment for Cross-Lingual Stance DetectionRuike Zhang, Nan Xu, Hanxuan Yang, Yuan Tian et al.ACL Findings 2023 · 5 citations
  4. MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media TextsDominik Macko, Jakub Kopal, Róbert Móro, Ivan SrbaACL 2025 · 15 citations
  5. An LLM-Enabled Knowledge Elicitation and Retrieval Framework for Zero-Shot Cross-Lingual Stance IdentificationRuike Zhang, Yuan Tian, Penghui Wei, Daniel Zeng et al.EMNLP Findings 2024 · 6 citations
Dusk over the sea between two cliffs drawn in fine vertical lines