"In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual Reality
Hans-Christian Jetter, Roman Rädle, Tiare M. Feuchtner, Christoph Anthes, Judith Friedl, Clemens Nylandsted Klokmose
Abstract
We propose using virtual reality (VR) as a design tool for sketching and simulating spatially-aware interactive spaces. Using VR, designers can quickly experience their envisioned spaces and interactions by simulating technologies such as motion tracking, multiple networked devices, or unusual form factors such as spherical touchscreens or bezel-less display tiles. Design ideas can be rapidly iterated without restrictions by the number, size, or shape and availability of devices or sensors in the lab. To understand the potentials and challenges of designing in VR, we conducted a user study with 12 interaction designers. As their tool, they used a custom-built virtual design environment with finger tracking and physics simulations for natural interactions with virtual devices and objects. Our study identified the designers' experience of space in relation to their own bodies and playful design explorations as key opportunities. Key challenges were the complexities of building a usable yet versatile VR-based "World Editor".
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9f1b6cd8-b98f-45ab-a141-228b0714d793Cited by top-tier papers6
- ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User StudiesSebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch et al.CHI 2022 · 99 citations
- MineXR: Mining Personalized Extended Reality InterfacesHyunsung Cho, Yukang Yan, Kashyap Todi, Mark Parent et al.CHI 2024 · 22 citations
- ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDHui Ye, Jiaye Leng, Chufeng Xiao, Lili Wang et al.CHI 2023 · 17 citations
- Using Virtual Reality to Shape Humanity's Return to the Moon: Key Takeaways from a Design StudyTommy Nilsson, Flavie Rometsch, Leonie Becker, Florian Dufresne et al.CHI 2023 · 16 citations
- An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingRichard Rodriguez, Brian T. Sullivan, Mayra Donaji Barrera Machuca, Anil Ufuk Batmaz et al.CHI 2024 · 15 citations
Related papers
- VR for Design: Exploring Long-Term Experiences and Workflows of 3D Designing in Virtual RealityVille Mäkelä, Daniel Harley, Jieun Lee, Cayley MacArthurCHI 2026 · 1 citation
- VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual RealityTobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo et al.CHI 2020 · 157 citations
- UltraEdit: In-Situ Design Environment for Ultrasound HaptizationRichard Huynh Noeske, Ayush Bhardwaj, Abbas Khawaja, Jin Ryong KimUIST 2025 · 3 citations
- HandPainter - 3D Sketching in VR with Hand-based Physical ProxyYing Jiang, Congyi Zhang, Hongbo Fu, Alberto Cannavò et al.CHI 2021 · 61 citations
- The Design Space of the Auditory Representation of Objects and Their Behaviours in Virtual Reality for Blind PeopleJoão Guerreiro, Yujin Kim, Rodrigo Nogueira, Seung A. Chung et al.IEEE VR 2023 · 32 citations
