Mapping the Wizards' Path: A Systematic Review of Wizard-of-Oz in HCI
Ruoxuan Yang, Yuwei Du, Hongyang Du, Kaibin Huang
Abstract
The Wizard-of-Oz (WoZ) method has long been a core prototyping technique in Human-Computer Interaction (HCI), in which users interact with systems that seem autonomous but are actually controlled by hidden human operators. Advances in interactive technologies have expanded the landscape of future system behaviors, broadening both where and how WoZ is used. However, as more envisioned behaviors become technically feasible, the distinction between engineering a system and simulating an interaction becomes blurred, making it essential to clarify when and why to employ wizarding. This paper presents the first systematic review of WoZ in HCI, drawing on 194 papers from SIGCHI venues to identify ten application domains, five wizard control types, eight motivations, and five categories of concerns. Building on these findings, we propose a reciprocal evolution framework that interprets how technology and wizarding shape each other, and derive guidelines for the rigorous application of WoZ. We further illustrate the framework through emerging prototyping practices with Large Language Models (LLMs).
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 5bfc574a-a93a-4c31-b331-e098fa01e45eRelated papers
- AI of Oz: Enhancing Wizard of Oz Studies in HCI with AI Assistance for Human ModerationRuoyu Wen, Kunal Gupta, Kekayan Nanthakumar, Binyang Han et al.CHI 2026 · 1 citation
- Pulling Back the Curtain on the Wizards of OzMartin Porcheron, Joel E. Fischer, Stuart ReevesCSCW 2020 · 30 citations
- Wizundry: A Cooperative Wizard of Oz Platform for Simulating Future Speech-based Interfaces with Multiple WizardsSiying Hu, Hen Chen Yen, Ziwei Yu, Mingjian Zhao et al.CSCW 2023 · 10 citations
- Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature ReviewRock Yuren Pang, Hope Schroeder, Kynnedy Simone Smith, Solon Barocas et al.CHI 2025 · 51 citations
- 'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research PracticesShivani Kapania, Ruiyi Wang, Toby Jia-Jun Li, Tianshi Li et al.CSCW 2025 · 31 citations
