Comparison of Cross-Reality Transition Techniques Between 3D and 2D Display Spaces in Desktop-AR Systems
Robbe Cools, Inne Maerevoet, Matt Gottsacker, Adalberto L. Simeone
Abstract
The aim of this study is to develop an understanding of how virtual objects can be transitioned between 3D Augmented Reality and 2D standard monitor display spaces. The increased availability of Augmented Reality devices, in combination with the prevalence of conventional desktop setups with mouse and keyboard input, gives rise to future hybrid setups in which users may need to transition virtual objects between display spaces. We developed three virtual object transition techniques: Mouse-based, Hand-based, and a Modality Switch (where users can only use the input methods in their respective display spaces). The three techniques were evaluated in a user study (N=24) alongside a fourth condition in which participants could freely switch between Hand and Mouse-based techniques. Participants were tasked with transitioning virtual bricks from 3D space onto the screen, then using the mouse to make fine adjustments, such as choosing the colour of the brick and placing decorations, to then transition them back into 3D space to build with. The Modality Switch technique was not preferred due to higher mental demand. Participants preferred the mouse-based technique, which allowed them to transition the virtual bricks faster.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3f409d8-42fb-417a-b2bb-a501d92cb380Builds on12
- Grand Challenges in Immersive AnalyticsBarrett Ens, Benjamin Bach, Maxime Cordeil, Ulrich Engelke et al.CHI 2021 · 220 citations
- BISHARE: Exploring Bidirectional Interactions Between Smartphones and Head-Mounted Augmented RealityFengyuan Zhu, Tovi GrossmanCHI 2020 · 134 citations
- MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisRicardo Langner, Marc Satkowski, Wolfgang Büschel, Raimund DachseltCHI 2021 · 108 citations
- In-Depth Mouse: Integrating Desktop Mouse into Virtual RealityQian Zhou, George W. Fitzmaurice, Fraser AndersonCHI 2022 · 105 citations
- ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User StudiesSebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch et al.CHI 2022 · 99 citations
Related papers
- Traversing Dual Realities: Investigating Techniques for Transitioning 3D Objects between Desktop and Augmented Reality EnvironmentsTobias Rau, Tobias Isenberg, Andreas Köhn, Michael Sedlmair et al.CHI 2025 · 8 citations
- Spatial Bar: Exploring Window Switching Techniques for Large Virtual DisplaysLeonardo Pavanatto, Jens Grubert, Doug A. BowmanIEEE VR 2025 · 8 citations
- A Qualitative Investigation of User Transitions and Frictions in Cross-Reality ApplicationsJulius von Willich, Frank Nelles, Wen-Jie Tseng, Jan Gugenheimer et al.CHI 2025 · 5 citations
- Do we still need physical monitors? An evaluation of the usability of AR virtual monitors for productivity workLeonardo Pavanatto, Chris North, Doug A. Bowman, Carmen Badea et al.IEEE VR 2021 · 90 citations
- SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop InterfacesJohann Wentzel, Fraser Anderson, George W. Fitzmaurice, Tovi Grossman et al.CHI 2024 · 13 citations
