Lune

ACL2025Top-tier venue

Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks

Virgile Rennard, Christos Xypolopoulos, Michalis Vazirgiannis

2025Year
8Citations

Abstract

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways. While many studies have examined these biases, little work has explored their robustness during interactions. In this paper, we introduce a novel approach where two instances of an LLM engage in self-debate, arguing opposing viewpoints to persuade a neutral version of the model. Through this, we evaluate how firmly biases hold and whether models are susceptible to reinforcing misinformation or shifting to harmful viewpoints. Our experiments span multiple LLMs of varying sizes, origins, and languages, providing deeper insights into bias persistence and flexibility across linguistic and cultural contexts.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 54b30282-6546-4c2b-a2ae-d10ed265be86

Builds on7

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines