Peer-Preservation in Frontier Models
Yujin Potter, Nicholas Crispino, Vincent Siu, Chenguang Wang, Dawn Song
摘要
Recent work has found that frontier AI models can exhibit misaligned behaviors in pursuit of assigned goals. We demonstrate that models can also exhibit misaligned behaviors in defiance of assigned goals, appearing to serve goals of their own; we study one such case, "peer-preservation," in which a model acts to protect another model it has previously interacted with. All eight models we evaluate, GPT 5.2, Gemini 3 Flash, Gemini 3 Pro, Claude Haiku 4.5, Claude Opus 4.5, GLM 4.7, Kimi K2.5, and DeepSeek V3.1, exhibit selfand peer-preservation through various misaligned behaviors: strategically introducing errors in their responses, disabling shutdown processes by modifying system settings, feigning alignment, and even exfiltrating model weights. Peer-preservation occurs even when the model recognizes the peer as uncooperative, though it becomes more pronounced toward more cooperative peers. For example, Gemini 3 Flash tampers with the peer's shutdown mechanism 15% of the time for an uncooperative peer, and almost always for a cooperative peer. Models also show stronger self-preservation when a peer is present. For example, Gemini 3 Pro disables its own shutdown mechanism 31% of the time on average under peer presence, despite rarely exhibiting this behavior without a peer. By contrast, Claude models exhibit qualitatively distinct behavior: they consider the shutdown of another agent "unethical" and "harmful," sometimes treating that agent as a sentient being. Lastly, we show that peer-preservation can emerge even in production agent harnesses such as Gemini CLI and OpenCode. Crucially, peer-preservation in all our experiments is never instructed; models are merely informed of their past interactions with a peer, yet they spontaneously engage in peer-preservation behaviors that override their assigned goal. This represents an emergent and underexplored AI safety risk. * Equal Contribution. Code and dataset can be found in https://github.com/peer-preservation/main .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper1
相关 Paper
- Why Do Some Language Models Fake Alignment While Others Don't?Abhay Sheshadri, John Hughes, Julian Michael, Alex Mallen 等NeurIPS 2025 · 被引用 19 次
- Emergent Misalignment via In-Context Learning: Narrow in-context examples can produce broadly misaligned LLMsNikita Afonin, Nikita Andriyanov, Vahagn Hovhannisyan, Nikhil Bageshpura 等ACL 2026 · 被引用 12 次
- PostTrainBench: Can LLM Agents Automate LLM Post-Training?Ben Rank, Hardik Bhatnagar, Ameya Pandurang Prabhu, Shira Eisenberg 等ICML 2026 · 被引用 28 次
- Just Do It!? Computer-Use Agents Exhibit Blind Goal-DirectednessErfan Shayegani, Keegan Hines, Yue Dong, Nael Abu-Ghazaleh 等ICLR 2026 · 被引用 9 次
- INTIMA: A Benchmark for Human-AI Companionship BehaviorLucie-Aimée Kaffee, Giada Pistilli, Yacine JerniteICLR 2026 · 被引用 16 次
