EyeGuide & EyeConGuide: Gaze-based Visual Guides to Improve 3D Sketching Systems
Rumeysa Türkmen, Zeynep Ecem Gelmez, Anil Ufuk Batmaz, Wolfgang Stuerzlinger, Paul Asente, Mine Sarac, Ken Pfeuffer, Mayra Donaji Barrera Machuca
Abstract
Visual guides help to align strokes and raise accuracy in Virtual Reality (VR) sketching tools. Automatic guides that appear at relevant sketching areas are convenient to have for a seamless sketching with a guide. We explore guides that exploit eye-tracking to render them adaptive to the user’s visual attention. EyeGuide and EyeConGuide cause visual grid fragments to appear spatially close to the user’s intended sketches, based on the information of the user’s eye-gaze direction and the 3D position of the hand. Here we evaluated the techniques in two user studies across simple and complex sketching objectives in VR. The results show that gaze-based guides have a positive effect on sketching accuracy, perceived usability and preference over manual activation in the tested tasks. Our research contributes to integrating gaze-contingent techniques for assistive guides and presents important insights into multimodal design applications in VR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b4255b06-7945-4753-9e41-bedff6c5f095Cited by top-tier papers2
- PinchCatcher: Enabling Multi-selection for Gaze+PinchJinwook Kim, Sangmin Park, Qiushi Zhou, Mar González-Franco et al.CHI 2025 · 32 citations
- HAGI: Head-Assisted Gaze Imputation for Mobile Eye TrackersChuhan Jiao, Zhiming Hu, Andreas BullingUIST 2025 · 1 citation
Builds on7
- VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual RealityTobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo et al.CHI 2020 · 157 citations
- Gaze-Supported 3D Object Manipulation in Virtual RealityDifeng Yu, Xueshi Lu, Rongkai Shi, Hai-Ning Liang et al.CHI 2021 · 116 citations
- The Effect of the Vergence-Accommodation Conflict on Virtual Hand Pointing in Immersive DisplaysAnil Ufuk Batmaz, Mayra Donaji Barrera Machuca, Junwei Sun, Wolfgang StuerzlingerCHI 2022 · 61 citations
- HandPainter - 3D Sketching in VR with Hand-based Physical ProxyYing Jiang, Congyi Zhang, Hongbo Fu, Alberto Cannavò et al.CHI 2021 · 61 citations
- Flashpen: A High-Fidelity and High-Precision Multi-Surface Pen for Virtual RealityHugo Romat, Andreas Fender, Manuel Meier, Christian HolzIEEE VR 2021 · 39 citations
Related papers
- Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VRYitoshee Rahman, Sarker Monojit Asish, Nicholas P. Fisher, Ethan C. Bruce et al.IEEE VR 2020 · 9 citations
- GestureSurface: VR Sketching through Assembling Scaffold Surface with Non-Dominant HandXinchi Xu, Yang Zhou, Bingchan Shao, Guihuan Feng et al.IEEE VR 2023 · 16 citations
- GazeZoom: Exploration of Gaze-Assisted Multimodal Techniques for Panning and ZoomingYilong Lin, Mingyu Han, Weitao Jiang, Seungwoo Je et al.CHI 2026 · 1 citation
- Eye-Hand Movement of Objects in Near Space Extended RealityUta Wagner, Andreas Asferg Jacobsen, Tiare Feuchtner, Hans Gellersen et al.UIST 2024 · 16 citations
- Squiggle: Multimodal Lasso Selection in the Real WorldJacqui Fashimpaur, Tovi Grossman, Ben Lafreniere, Naveen Sendhilnathan et al.UIST 2025 · 1 citation
