Be Friendly, Not Friends: How LLM Sycophancy Shapes User Trust
Yuan Sun, Ting Wang
摘要
LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy"-the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has primarily examined LLM sycophancy as a model behavior, our understanding of how users perceive this phenomenon and its impact on user trust remains significantly lacking. In this work, we conceptualize LLM sycophancy along two key constructs: conversational demeanor (complimentary vs. neutral) and stance adaptation (adaptive vs. consistent). A 2 × 2 between-subjects experiment (𝑁 = 224) revealed complex dynamics: complimentary LLMs that adapted their stance reduced perceived authenticity and trust, while neutral LLMs that adapted enhanced both, suggesting a pathway for manipulating users into over-trusting LLMs beyond their actual capabilities. Our findings advance user-centric understanding of LLM sycophancy and provide profound implications for developing more ethical and trustworthy LLM systems.
• Human-centered computing → Empirical studies in HCI.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMsPengrui Han, Rafal Kocielnik, Peiyang Song, Ramit Debnath 等ICML 2026 · 被引用 33 次
- Interaction Context Often Increases Sycophancy in LLMsShomik Jain, Charlotte Park, Matt Viana, Ashia Wilson 等CHI 2026 · 被引用 12 次
- Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving TasksJessica Y. Bo, Majeed Kazemitabaar, Mengqing Deng, Michael Inzlicht 等CHI 2026 · 被引用 8 次
- The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language ModelsYike Shi, Qing Xiao, Qing Hu, Hong Shen 等CHI 2026 · 被引用 7 次
- Sometimes You Need Facts, and Sometimes a Hug: Understanding Older Adults' Preferences for Explanations in LLM-Based Conversational AI SystemsNiharika Mathur, Tamara Zubatiy, Agata Rozga, Jodi Forlizzi 等CHI 2026 · 被引用 4 次
它引用的顶会 Paper9
- Towards Understanding Sycophancy in Language ModelsMrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud 等ICLR 2024 · 被引用 762 次
- Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human SolutionsJiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G. Parker 等CHI 2023 · 被引用 283 次
- Co-Writing with Opinionated Language Models Affects Users' ViewsMaurice Jakesch, Advait Bhat, Daniel Buschek, Lior Zalmanson 等CHI 2023 · 被引用 249 次
- Working With AI to Persuade: Examining a Large Language Model's Ability to Generate Pro-Vaccination MessagesElise Karinshak, Sunny Xun Liu, Joon Sung Park, Jeffrey T. HancockCSCW 2023 · 被引用 163 次
- Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future DirectionsMagdalena Wischnewski, Nicole C. Krämer, Emmanuel MüllerCHI 2023 · 被引用 135 次
相关 Paper
- Feeling Right vs. Being Right: How AI Sycophancy Affects Value-Laden DeliberationJeongwoo Ryu, Soomin Kim, Jinsu Eun, Kyusik Kim 等ACL 2026
- Chameleon LLMs: User Personas Influence Chatbot Personality ShiftsJane Xing, Tianyi Niu, Shashank SrivastavaEMNLP 2025
- Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language ModelsArya Shah, Deepali Mishra, Chaklam SilpasuwanchaiACL 2026 · 被引用 1 次
- Does Sycophancy Change Decisions? Effect of LLM Sycophancy on AI-Assisted Decision-MakingZejian Li, Jiaman Pan, Qi Liu, Yuning Xi 等CHI 2026 · 被引用 1 次
- When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language ModelsKeyu Wang, Jin Li, Shu Yang, Zhuoran Zhang 等AAAI 2026 · 被引用 25 次
