From Following to Understanding: Investigating the Role of Reflective Prompts in AR-Guided Tasks to Promote User Understanding
Nandi Zhang, Yukang Yan, Ryo Suzuki
Abstract
Augmented Reality (AR) is a promising medium for guiding users through tasks, yet its impact on fostering deeper task understanding remains underexplored. This paper investigates the impact of reflective prompts -- strategic questions that encourage users to challenge assumptions, connect actions to outcomes, and consider hypothetical scenarios -- on task comprehension and performance. We conducted a two-phase study: a formative survey and co-design sessions (N=9) to develop reflective prompts, followed by a within-subject evaluation (N=16) comparing AR instructions with and without these prompts in coffee-making and circuit assembly tasks. Our results show that reflective prompts significantly improved objective task understanding and resulted in more proactive information acquisition behaviors during task completion. These findings highlight the potential of incorporating reflective elements into AR instructions to foster deeper engagement and learning. Based on data from both studies, we synthesized design guidelines for integrating reflective elements into AR systems to enhance user understanding without compromising task performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 322b52dc-a58f-4cda-ac57-93999aaf80bfCited by top-tier papers3
- Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision ModelsAda Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do, Ryo SuzukiUIST 2025 · 12 citations
- Who Controls the Conversation? User Perspectives on Generative AI (LLM) System PromptsAnna Neumann, Yulu Pi, Jatinder SinghCHI 2026 · 3 citations
- Empowering Children to Create AI-Enabled Augmented Reality ExperiencesLei Zhang, Shuyao Zhou, Amna Liaqat, Tinney Mak et al.UIST 2025 · 1 citation
Builds on2
- The Metacognitive Demands and Opportunities of Generative AILev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott et al.CHI 2024 · 279 citations
- ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityGuande Wu, Jing Qian, Sonia Castelo Quispe, Shaoyu Chen et al.CHI 2024 · 20 citations
Related papers
- A Comparison of Spatial Augmented Reality Predictive Cues and their Effects on Sleep Deprived UsersBenjamin Volmer, James Baumeister, Raymond Matthews, Linda Grosser et al.IEEE VR 2022 · 10 citations
- What Are You Really Asking For? A Comparative 5W1H Analysis of Learner Questioning in CPR Training with IVAs in Screen-based and Augmented Reality EnvironmentsHyerim Park, Jinseok Hong, Heejeong Ko, Woontack WooCHI 2026 · 2 citations
- AR-Enhanced Workouts: Exploring Visual Cues for At-Home Workout Videos in AR EnvironmentYihong Wu, Lingyun Yu, Jie Xu, Dazhen Deng et al.UIST 2023 · 26 citations
- Augmented Reality and Older Adults: A Comparison of Prompting TypesThomas J. Williams, Simon L. Jones, Christof Lutteroth, Elies Dekoninck et al.CHI 2021 · 19 citations
- Assisting Manipulation and Grasping in Robot Teleoperation with Augmented Reality Visual CuesStephanie Arévalo Arboleda, Franziska Rücker, Tim Dierks, Jens GerkenCHI 2021 · 59 citations
