Lune

ACL Findings2026

Talent or Luck? Evaluating Attribution Bias in Large Language Models

Chahat Raj, Mahika Banerjee, Jinhao Pan, Aylin Caliskan, Antonios Anastasopoulos, Ziwei Zhu

Abstract

When a student fails an exam, do we tend to blame their effort or the test's difficulty? Attribution, defined as how reasons are assigned to event outcomes, shapes perceptions, reinforces stereotypes, and influences decisions. Attribution Theory explains how people attribute causes to internal factors (effort, ability) or external ones (task difficulty, luck). Large Language Models' (LLMs) attribution of event outcomes based on demographics carries important fairness implications. Most works exploring social biases in LLMs focus on surfacelevel associations or isolated stereotypes. This work proposes a cognitively grounded bias evaluation framework to identify how models' output disparities shape demographic bias across three contexts: Single-Actor, Actor-Actor, and Actor-Observer, capturing comparative and perspective-driven biases overlooked in prior work. Introducing a 140k-prompt benchmark covering ten scenarios and four social dimensions, our analyses reveal attribution asymmetries across identities that vary in multi-actor and observer settings, suggesting that other identities influence bias. This work underscores the need for cognitively grounded bias evaluation and informs future debiasing efforts through the proposed framework. Our code and data are available at this repository. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Cognitive Bias in Decision-Making with LLMs cites Towards Understanding and Mitigating Social Biases in Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on11

  1. Towards Understanding and Mitigating Social Biases in Language ModelsPaul Pu Liang, Chiyu Wu, Louis-Philippe Morency, Ruslan SalakhutdinovICML 2021 · 495 citations
  2. The Unreliability of Explanations in Few-shot Prompting for Textual ReasoningXi Ye, Greg DurrettNeurIPS 2022 · 272 citations
  3. BBQ: A hand-built bias benchmark for question answeringAlicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar et al.ACL Findings 2022 · 186 citations
  4. "Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference LettersYixin Wan, George Pu, Jiao Sun, Aparna Garimella et al.EMNLP Findings 2023 · 139 citations
  5. Cognitive Bias in Decision-Making with LLMsJessica Maria Echterhoff, Yao Liu, Abeer Alessa, Julian J. McAuley et al.EMNLP Findings 2024 · 62 citations

Related papers

  1. Bi-directional Bias Attribution: Debiasing Large Language Models without Modifying PromptsYujie Lin, Kunquan Li, Yixuan Liao, Xiaoxin Chen et al.ICLR 2026 · 6 citations
  2. DeFrame: Debiasing Large Language Models Against Framing EffectsKahee Lim, Soyeon Kim, Steven Euijong WhangACL Findings 2026
  3. Veracity Bias and Beyond: Uncovering LLMs' Hidden Beliefs in Problem-Solving ReasoningYue Zhou, Barbara Di EugenioACL 2025 · 1 citation
  4. Multi-Persona Thinking for Bias Mitigation in Large Language ModelsYuxing Chen, Guoqing Luo, Zijun Wu, Lili MouACL Findings 2026 · 1 citation
  5. Ask LLMs Directly, "What shapes your bias?": Measuring Social Bias in Large Language ModelsJisu Shin, Hoyun Song, Huije Lee, Soyeong Jeong et al.ACL Findings 2024 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines