"Here, Let Me Help": An Empirical Study of User Interventions in Human-Web Agent Collaboration
Joohee Kim, Sungbeom Cho, Duc M. Nguyen, Jaehyeong Jeon, Minjeong Shin, Sungahn Ko
Abstract
Web agents aim to execute complex online tasks from high-level instructions, yet fully autonomous execution remains challenging in practice. We present an empirical study of user interventions in human–web agent collaboration, moving beyond outcome-based metrics to examine how interventions unfold during execution. We conducted a controlled in-lab study with 30 participants whose interactions reflected early-stage web agent adoption across 12 structured tasks in shopping, travel, and information-seeking domains using live websites. Analyzing interaction logs, user inputs, and screen recordings, we identify diverse behaviors and propose a taxonomy capturing both the reasons for intervention and the forms they take. We distinguish explicit interventions, where users halt or override actions, from implicit interventions, where users guide or prepare the environment without stopping execution. Our findings reveal how task structure and execution breakdowns shape intervention behaviors to provide process-level evidence for designing web agents that better support users as active collaborators.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get b4e41e56-4da6-40f5-b485-375d361deba6Related papers
- Collaborating with a Text-Based Chatbot: An Exploration of Real-World Collaboration Strategies Enacted during Human-Chatbot InteractionsAmon Rapp, Arianna Boldi, Lorenzo Curti, Alessandro Perrucci et al.CHI 2023 · 20 citations
- GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI TasksSaelyne Yang, Jaesang Yu, Yi-Hao Peng, Kevin Qinghong Lin et al.CVPR 2026 · 5 citations
- On Optimizing Interventions in Shared AutonomyWeihao Tan, David Koleczek, Siddhant Pradhan, Nicholas Perello et al.AAAI 2022 · 6 citations
- Characterizing Unintended Consequences of GUI Agents For Web BrowsingShuning Zhang, Jingruo Chen, Zhiqi Gao, Jiajing Gao et al.CHI 2026 · 1 citation
- UINavBench: A Framework for Comprehensive Evaluation of Interactive Digital AgentsHarsh Agrawal, Eldon Schoop, Xinlei Pan, Anuj Mahajan et al.ICCV 2025 · 9 citations
