EMNLP2025
Fair or Framed? Political Bias in News Articles Generated by LLMs
Junho Yoo, Youhyun Shin
被引用 1 次
摘要
Despite biases in Large Language Models (LLMs) being widely researched, systematic explorations of political biases in news article generation tasks remain underexplored. This study evaluates political bias across seven LLMs by leveraging our PublicViews datasetextracted from the TwinViews-13k corpuscomprising 31 topics and 31,692 statements. We analyze 10,850 articles, finding left-leaning political bias persists in generation tasks, with neutral content remaining rare even under balanced opinion settings. Models exhibit asymmetric behavior in minority opinion scenarios, amplifying preferred viewpoints when in minority while conforming to majority opinions otherwise. Notably, all models employ "stanceflipping quotations" (altering supporters' statements to express opposite viewpoints) in 33-38% of quotations despite explicit instructions against distortion. Consistent with prior research, increased model size failed to enhance neutrality. This research measures political bias in LLM-generated news, analyzes its mechanisms, and reveals how opinion distribution and explicitness affect political bias expression. Our results highlight how LLMs can introduce unintended political bias in generative contexts. We publicly release our PublicViews corpus and code 1 .