Investigating Generative Workflows for Immersive Prototyping: A Study on Scene- and Object-Level Creation in VR
Cheng-Chih Tsai, Ping-Hsuan Han, Tse-Yu Pan
Abstract
The integration of generative AI into immersive prototyping tools offers unprecedented potential to accelerate VR content creation. However, a critical gap exists in understanding the most effective interaction paradigms. We present DreamCraft, a novel VR prototyping system designed to integrate two fundamental workflows: scene-level creation, where users generate entire, navigable environments, and object-level creation, where scenes are iteratively populated with AI-generated assets. A formal user study with 12 VR designers was conducted to evaluate these workflows, evaluating both workflows through qualitative feedback and quantitative metrics, including task completion time, creative exploration, and perceived cognitive load. Our primary contribution is a set of empirically-grounded design guidelines derived from this analysis. These guidelines provide a crucial framework for the development of next-generation, user-centric generative tools for immersive virtual environments, directly informing future research and system design in the field.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and OutputsCyrus Vachha, Yixiao Kang, Zach Dive, Ashwat Chidambaram et al.CHI 2025 · 8 citations
- VRCopilot: Authoring 3D Layouts with Generative AI Models in VRLei Zhang, Jin Pan, Jacob Gettig, Steve Oney et al.UIST 2024 · 53 citations
- CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual RealityJulian Rasch, Julia Töws, Teresa Hirzle, Florian Müller et al.CHI 2025 · 11 citations
- Neural Canvas: Supporting Scenic Design Prototyping by Integrating 3D Sketching and Generative AIYulin Shen, Yifei Shen, Jiawen Cheng, Chutian Jiang et al.CHI 2024 · 41 citations
- HOICraft: In-Situ VLM-based Authoring Tool for Part-Level Hand-Object Interaction Design in VRDohui Lee, Qi Sun, Sang Ho YoonCHI 2026 · 1 citation
