"AI enhances our performance, I have no doubt this one will do the same": The Placebo effect is robust to negative descriptions of AI
Agnes Mercedes Kloft, Robin Welsch, Thomas Kosch, Steeven Villa
Abstract
Heightened AI expectations facilitate performance in human-AI interactions through placebo effects. While lowering expectations to control for placebo effects is advisable, overly negative expectations could induce nocebo effects. In a letter discrimination task, we informed participants that an AI would either increase or decrease their performance by adapting the interface, when in reality, no AI was present in any condition. A Bayesian analysis showed that participants had high expectations and performed descriptively better irrespective of the AI description when a sham-AI was present. Using cognitive modeling, we could trace this advantage back to participants gathering more information. A replication study verified that negative AI descriptions do not alter expectations, suggesting that performance expectations with AI are biased and robust to negative verbal descriptions. We discuss the impact of user expectations on AI interactions and evaluation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c9682ddb-5345-49ee-a1c9-cefccb64cc46Cited by top-tier papers10
- Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human PreferencesShreya Shankar, J. D. Zamfirescu-Pereira, Bjoern Hartmann, Aditya G. Parameswaran et al.UIST 2024 · 143 citations
- Assessing User Apprehensions About Mixed Reality Artifacts and Applications: The Mixed Reality Concerns (MRC) QuestionnaireChristopher Katins, Pawel W. Wozniak, Aodi Chen, Ihsan Tumay et al.CHI 2024 · 15 citations
- Mental Models of Autonomy and Sentience Shape Reactions to AIJanet V. T. Pauketat, Daniel B. Shank, Aikaterina Manoli, Jacy Reese AnthisCHI 2026 · 7 citations
- Placebo Effect of Control Settings in Feeds Are Not Always StrongSilas Hsu, Vinay Koshy, Kristen Vaccaro, Christian Sandvig et al.CHI 2025 · 6 citations
- PlanTogether: Facilitating AI Application Planning Using Information Graphs and Large Language ModelsDae Hyun Kim, Daeheon Jeong, Shakhnozakhon Yadgarova, Hyungyu Shin et al.CHI 2025 · 5 citations
Builds on5
- "An Ideal Human": Expectations of AI Teammates in Human-AI TeamingRui Zhang, Nathan J. McNeese, Guo Freeman, Geoff MusickCSCW 2020 · 222 citations
- Computational Rationality as a Theory of InteractionAntti Oulasvirta, Jussi P. P. Jokinen, Andrew HowesCHI 2022 · 127 citations
- Human-AI Interaction in Human Resource Management: Understanding Why Employees Resist Algorithmic Evaluation at Workplaces and How to Mitigate BurdensHyanghee Park, Daehwan Ahn, Kartik Hosanagar, Joonhwan LeeCHI 2021 · 117 citations
- Exploring User Expectations of Proactive AI SystemsChristian Meurisch, Cristina A. Mihale-Wilson, Adrian Hawlitschek, Florian Giger et al.UbiComp 2021 · 66 citations
- A Critique of Electrodermal Activity Practices at CHIEbrahim Babaei, Benjamin Tag, Tilman Dingler, Eduardo VellosoCHI 2021 · 64 citations
Related papers
- Inform, Explain, or Control: Techniques to Adjust End-User Performance Expectations for a Conversational Agent Facilitating Group Chat DiscussionsHyo Jin Do, Ha Kyung Kong, Pooja Tetali, Karrie Karahalios et al.CSCW 2023 · 9 citations
- From Expectation to Evaluation: Expectation Cues Systematically Bias LLM and Human JudgmentYiteng Sun, Danica Dillion, Kurt Gray, Mengtao Lyu et al.CHI 2026 · 1 citation
- Uncalibrated Models Can Improve Human-AI CollaborationKailas Vodrahalli, Tobias Gerstenberg, James Y. ZouNeurIPS 2022 · 47 citations
- Personal Validation Effect in LLMs: Positive AI Responses Bias Perceptions of Validity, Reliability, Personalization, and Usefulness of Fictitious PredictionsPat Pataranutaporn, Eunhae Lee, Judith Amores, Pattie MaesCHI 2026 · 1 citation
- Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving TasksJessica Y. Bo, Majeed Kazemitabaar, Mengqing Deng, Michael Inzlicht et al.CHI 2026 · 8 citations
