Facilitating Proactive and Reactive Guidance for Decision Making on the Web: A Design Probe with WebSeek
Yanwei Huang, Arpit Narechania
Abstract
Web AI agents such as ChatGPT Agent and GenSpark are increasingly used for routine web-based tasks, yet they still rely on text-based input prompts, lack proactive detection of user intent, and offer no support for interactive data analysis and decision making. We present WebSeek, a mixed-initiative browser extension that enables users to discover and extract information from webpages to then flexibly build, transform, and refine tangible data artifacts–such as tables, lists, and visualizations–all within an interactive canvas. Within this environment, users can perform analysis–including data transformations such as joining tables or creating visualizations–while an in-built AI both proactively offers context-aware guidance and automation, and reactively responds to explicit user requests. An exploratory user study (N=15) with WebSeek as a probe reveals participants’ diverse analysis strategies, underscoring their desire for transparency and control during human-AI collaboration.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cad0cfcd-f36d-43fa-bbfc-3d76e6a2d912Builds on21
- Fine-Grained Visual PromptingLingfeng Yang, Yueze Wang, Xiang Li, Xinlong Wang et al.NeurIPS 2023 · 129 citations
- DirectGPT: A Direct Manipulation Interface to Interact with Large Language ModelsDamien Masson, Sylvain Malacria, Géry Casiez, Daniel VogelCHI 2024 · 104 citations
- Collecting and Characterizing Natural Language Utterances for Specifying Data VisualizationsArjun Srinivasan, Nikhila Nyapathy, Bongshin Lee, Steven Mark Drucker et al.CHI 2021 · 55 citations
- Lyra 2: Designing Interactive Visualizations by DemonstrationJonathan Zong, Dhiraj Barnwal, Rupayan Neogy, Arvind SatyanarayanIEEE VIS 2020 · 50 citations
- Supporting Expressive and Faithful Pictorial Visualization Design with Visual Style TransferYang Shi, Pei Liu, Siji Chen, Mengdi Sun et al.IEEE VIS 2022 · 40 citations
Related papers
- Orca: Browsing at Scale Through User-Driven and AI-Facilitated Orchestration Across Malleable WebpagesPeiling Jiang, Haijun XiaCHI 2026 · 1 citation
- Marco: Supporting Business Document Workflows via Collection-Centric Information Foraging with Large Language ModelsRaymond Fok, Nedim Lipka, Tong Sun, Alexa F. SiuCHI 2024 · 21 citations
- Big Help or Big Brother? Auditing Tracking, Profiling, and Personalization in Generative AI AssistantsYash Vekaria, Aurelio Loris Canino, Jonathan Levitsky, Alex Ciechonski et al.USENIX Security 2025
- A Comparative Study of Users' Information-Seeking Practices Across Search Engines and Generative AI ChatbotsElsa Lichtenegger, Aleksandra Urman, Aniko HannakSIGIR 2026
- Dango: A Mixed-Initiative Data Wrangling System using Large Language ModelWei-Hao Chen, Weixi Tong, Amanda Case, Tianyi ZhangCHI 2025 · 19 citations
