An Artists' Perspectives on Natural Interactions for Virtual Reality 3D Sketching
Richard Rodriguez, Brian T. Sullivan, Mayra Donaji Barrera Machuca, Anil Ufuk Batmaz, Cyane Tornatzky, Francisco R. Ortega
Abstract
Virtual Reality (VR) applications like OpenBrush offer artists access to 3D sketching tools within the digital 3D virtual space. These 3D sketching tools allow users to “paint” using virtual digital strokes that emulate real-world mark-making. Yet, users paint these strokes through (unimodal) VR controllers. Given that sketching in VR is a relatively nascent field, this paper investigates ways to expand our understanding of sketching in virtual space, taking full advantage of what an immersive digital canvas offers. Through a study conducted with the participation of artists, we identify potential methods for natural multimodal and unimodal interaction techniques in 3D sketching. These methods demonstrate ways to incrementally improve existing interaction techniques and incorporate artistic feedback into the design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D ScenesJunlong Chen, Jens Grubert, Per Ola KristenssonIEEE VR 2025 · 9 citations
- Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive InteractionZhuoyue Lyu, Per Ola KristenssonCHI 2026 · 3 citations
Builds on6
- VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual RealityTobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo et al.CHI 2020 · 157 citations
- "In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual RealityHans-Christian Jetter, Roman Rädle, Tiare M. Feuchtner, Christoph Anthes et al.CHI 2020 · 64 citations
- The Effect of the Vergence-Accommodation Conflict on Virtual Hand Pointing in Immersive DisplaysAnil Ufuk Batmaz, Mayra Donaji Barrera Machuca, Junwei Sun, Wolfgang StuerzlingerCHI 2022 · 61 citations
- HandPainter - 3D Sketching in VR with Hand-based Physical ProxyYing Jiang, Congyi Zhang, Hongbo Fu, Alberto Cannavò et al.CHI 2021 · 61 citations
- Flashpen: A High-Fidelity and High-Precision Multi-Surface Pen for Virtual RealityHugo Romat, Andreas Fender, Manuel Meier, Christian HolzIEEE VR 2021 · 39 citations
Related papers
- VR for Design: Exploring Long-Term Experiences and Workflows of 3D Designing in Virtual RealityVille Mäkelä, Daniel Harley, Jieun Lee, Cayley MacArthurCHI 2026 · 1 citation
- InfinitePaint: Painting in Virtual Reality with Passive Haptics Using Wet Brushes and a Physical Proxy CanvasAndreas Rene Fender, Thomas Roberts, Tiffany Luong, Christian HolzCHI 2023 · 15 citations
- WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VRXiaohui Tan, Zhenxuan He, Can Liu, Mingming Fan et al.CHI 2024 · 4 citations
- HPIPainting: A Hand-Pen Interaction for VR PaintingAng Cai, Chao Yao, Hongjun Liu, Changsheng Li et al.UbiComp 2025 · 1 citation
- 3D-Layers: Bringing Layer-Based Color Editing to VR PaintingEmilie Yu, Fanny Chevalier, Karan Singh, Adrien BousseauSIGGRAPH 2024 · 11 citations
