Perspective and Geometry Approaches to Mouse Cursor Control in Spatial Augmented Reality
Daekun Kim, Nikhita Joshi, Daniel Vogel
Abstract
Spatial augmented reality (SAR) can extend desktop computing out of the monitor and into our surroundings, but extending the standard style of mouse input is challenging due to real-world geometry irregularity, gaps, and occlusion. We identify two general approaches for controlling a mouse cursor in SAR: perspective-based approaches based on raycasting, such as Nacenta et. al’s Perspective Cursor, and geometry-based approaches that closely associate cursor movement with surface topology. For the latter, we introduce Everywhere Cursor, a geometry-based approach for indirect mouse cursor control for complex 3D surface geometry in SAR. A controlled experiment compares approaches. Results show the geometry-based Everywhere Cursor improves accuracy and precision by 29% to 60% on average in a tracing task, but when traversing long distances, the perspective-based Perspective Cursor and Raycasting techniques are 22% to 49% faster, albeit with 4% to 10% higher error rates.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
6 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- The Interaction of Cursor Warping and View Manipulation in Multi-Display XR Environments cites In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality
- SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop Interfaces cites In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality
- Comparison of Cross-Reality Transition Techniques Between 3D and 2D Display Spaces in Desktop-AR Systems cites In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality
- HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand Tracking cites In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality
Cited by top-tier papers6
- SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop InterfacesJohann Wentzel, Fraser Anderson, George W. Fitzmaurice, Tovi Grossman et al.CHI 2024 · 13 citations
- Comparison of Cross-Reality Transition Techniques Between 3D and 2D Display Spaces in Desktop-AR SystemsRobbe Cools, Inne Maerevoet, Matt Gottsacker, Adalberto L. SimeoneIEEE VR 2025 · 7 citations
- Unbounded: Object-Boundary Interaction in Mixed RealityZhuoyue Lyu, Per Ola KristenssonCHI 2026 · 2 citations
- HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand TrackingEsen K. Tütüncü, Mar González-Franco, Eric J. GonzalezUIST 2025 · 2 citations
- The Interaction of Cursor Warping and View Manipulation in Multi-Display XR EnvironmentsYuzheng Chen, Haopeng Wang, Hock Siang Lee, Florian Weidner et al.CHI 2026 · 1 citation
Builds on1
Related papers
- StabilizAR: Enabling Hands-Free Head Pointing while MobileYonghwan Shin, Mingyu Han, Ian OakleyUIST 2025 · 2 citations
- Effects of Depth Information on Visual Target Identification Task Performance in Shared Gaze EnvironmentsAustin Erickson, Nahal Norouzi, Kangsoo Kim, Joseph J. LaViola et al.IEEE VR 2020 · 19 citations
- VoiceRay: 3D Object Selection Technique for Occluded and Dense Environments in Virtual RealityRumeysa Türkmen, Zahra Rasoulifar, Anil Ufuk BatmazCHI 2026 · 2 citations
- CurvedTouch: Effects of Surface Curvature and Cursor Mapping Method for XR Touch Input on Curved SurfaceYubin Lee, Li-Wei Chan, Geehyuk Lee, Sang Ho YoonUbiComp 2026
- Spatial Bar: Exploring Window Switching Techniques for Large Virtual DisplaysLeonardo Pavanatto, Jens Grubert, Doug A. BowmanIEEE VR 2025 · 8 citations
