Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
Jingyu Tang, Chaoran Chen, Jiawen Li, Zhiping Zhang, Bingcan Guo, Ibrahim Khalilov, Simret Araya Gebreegziabher, Bingsheng Yao, Dakuo Wang, Yanfang Ye, Tianshi Li, Ziang Xiao
Abstract
The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is increasingly important. We present a two-phase empirical study examining how agents, human participants, and human-AI teams respond to 16 types of dark patterns across diverse scenarios. Phase 1 highlights that agents often fail to recognize dark patterns, and even when aware, prioritize task completion over protective action. Phase 2 revealed divergent failure modes: humans succumb due to cognitive shortcuts and habitual compliance, while agents falter from procedural blind spots. Human oversight improved avoidance but introduced costs such as attentional tunneling and cognitive load.
Our findings show neither humans nor agents are uniformly resilient, and collaboration introduces new vulnerabilities, suggesting design needs for transparency, adjustable autonomy, and oversight.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5e2cd0ad-85c4-4deb-81f2-967db1539ac9Cited by top-tier papers2
- Investigating the Impact of Dark Patterns on LLM-Based Web AgentsDevin Ersoy, Brandon Lee, Ananth Shreekumar, Arjun Arunasalam et al.S&P 2026 · 16 citations
- How Dark Patterns Manipulate Web AgentsPhil Cuvin, Hao Zhu, Diyi YangICLR 2026 · 9 citations
Builds on23
- Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought PromptingMiles Turpin, Julian Michael, Ethan Perez, Samuel R. BowmanNeurIPS 2023 · 1,792 citations
- Language Models can Solve Computer TasksGeunwoo Kim, Pierre Baldi, Stephen McAleerNeurIPS 2023 · 539 citations
- What Makes a Dark Pattern... Dark?: Design Attributes, Normative Considerations, and Measurement MethodsArunesh Mathur, Mihir Kshirsagar, Jonathan R. MayerCHI 2021 · 327 citations
- UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User PerceptionLinda Di Geronimo, Larissa Braz, Enrico Fregnan, Fabio Palomba et al.CHI 2020 · 262 citations
- Human-AI Collaboration via Conditional Delegation: A Case Study of Content ModerationVivian Lai, Samuel Carton, Rajat Bhatnagar, Q. Vera Liao et al.CHI 2022 · 135 citations
Related papers
- The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language ModelsYike Shi, Qing Xiao, Qing Hu, Hong Shen et al.CHI 2026 · 7 citations
- When Designers Meet GenAI: Understanding the Role of Prompt-to-Design Generators in Privacy Dark PatternsJingzhou Ye, Zhaojie Hu, Yao Li, Xueqiang WangS&P 2026
- Behavioral Indicators of Overreliance During Interaction with Conversational Language ModelsChang Liu, Qinyi Zhou, Xinjie Shen, Xingyu Bruce Liu et al.CHI 2026 · 4 citations
- Are Your Agents Upward Deceivers?Dadi Guo, Qingyu Liu, Dongrui Liu, Qihan Ren et al.ICML 2026 · 5 citations
- AidUI: Toward Automated Recognition of Dark Patterns in User InterfacesS. M. Hasan Mansur, Sabiha Salma, Damilola Awofisayo, Kevin MoranICSE 2023 · 27 citations
