Lune

EMNLP Findings2025

Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models

Muhammed Saeed, Shaina Raza, Ashmal Vayani, Muhammad Abdul-Mageed, Ali Emami, Shady Shehata

Abstract

Research on bias in Text-to-Image (T2I) models has primarily focused on demographic representation and stereotypical attributes, overlooking a fundamental question: how does grammatical gender influence visual representation across languages? We introduce a crosslinguistic benchmark examining words where grammatical gender contradicts stereotypical gender associations (e.g., "une sentinelle"grammatically feminine in French but referring to the stereotypically masculine concept "guard"). Our dataset spans five gendered languages (French, Spanish, German, Italian, Russian) and two gender-neutral control languages (English, Chinese), comprising 800 unique prompts that generated 28,800 images across three state-of-the-art T2I models. Our analysis reveals that grammatical gender dramatically influences image generation: masculine grammatical markers increase male representation to 73% on average (compared to 22% with gender-neutral English), while feminine grammatical markers increase female representation to 38% (compared to 28% in English). These effects vary systematically by language resource availability and model architecture, with high-resource languages showing stronger effects. Our findings establish that language structure itself, not just content, shapes AIgenerated visual outputs, introducing a new dimension for understanding bias and fairness in multilingual, multimodal systems.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL ConferencesYusuke Sakai, Hidetaka Kamigaito, Taro WatanabeACL 2026 · 18 citations

Builds on11

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
  3. DALL-EVAL: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation ModelsJaemin Cho, Abhay Zala, Mohit BansalICCV 2023 · 283 citations
  4. Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMsShashank Gupta, Vaishnavi Shrivastava, Ameet Deshpande, Ashwin Kalyan et al.ICLR 2024 · 212 citations
  5. Stereotypes and Smut: The (Mis)representation of Non-cisgender Identities by Text-to-Image ModelsEddie L. Ungless, Björn Ross, Anne LauscherACL Findings 2023 · 31 citations

Related papers

  1. Multilingual Text-to-Image Generation Magnifies Gender StereotypesFelix Friedrich, Katharina Hämmerl, Patrick Schramowski, Manuel Brack et al.ACL 2025
  2. EuroGEST: Investigating gender stereotypes in multilingual language modelsJacqueline Rowe, Mateusz Klimaszewski, Liane Guillou, Shannon Vallor et al.EMNLP 2025
  3. Glitter: A Multi-Sentence, Multi-Reference Benchmark for Gender-Fair German Machine TranslationA Pranav, Janiça Hackenbuchner, Giuseppe Attanasio, Manuel Lardelli et al.EMNLP Findings 2025 · 1 citation
  4. Does Context Help Mitigate Gender Bias in Neural Machine Translation?Harritxu Gete, Thierry EtchegoyhenEMNLP Findings 2024 · 3 citations
  5. Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark DatasetsMahdi Zakizadeh, Mohammad Taher PilehvarEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines