UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self Entities
Siyou Pei, David Kim, Alex Olwal, Yang Zhang, Ruofei Du
Abstract
Extended reality (XR) has the potential for seamless user interface (UI) transitions across people, objects, and environments. However, the design space, applications, and common practices of 3D UI transitions remain underexplored. To address this gap, we conducted a need-finding study with 11 participants, identifying and distilling a taxonomy based on three types of UI placements — affixed to static, dynamic, or self entities. We further surveyed 113 commercial applications to understand the common practices of 3D UI mobility control, where only 6.2% of these applications allowed users to transition UI between entities. In response, we built interaction prototypes to facilitate UI transitions between entities. We report on results from a qualitative user study (N=14) on 3D UI mobility control using our FingerSwitches technique, which suggests that perceived usefulness is affected by types of entities and environments. We aspire to tackle a vital need in UI mobility within XR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fb7e3c9d-8184-4d6a-a874-16a705f0841cCited by top-tier papers6
- PinchCatcher: Enabling Multi-selection for Gaze+PinchJinwook Kim, Sangmin Park, Qiushi Zhou, Mar González-Franco et al.CHI 2025 · 32 citations
- Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR AgentsGeonsun Lee, Min Xia, Nels Numan, Xun Qian et al.UIST 2025 · 15 citations
- Since U Been Gone: Augmenting Context-Aware Transcriptions for Re-Engaging in Immersive VR MeetingsGeonsun Lee, Yue Yang, Jennifer Healey, Dinesh ManochaCHI 2025 · 13 citations
- T2IRay: Design of Thumb-to-Index based Indirect Pointing for Continuous and Robust AR/VR InputJina Kim, Yang Zhang, Sang Ho YoonCHI 2025 · 8 citations
- At a Glance to Your Fingertips: Enabling Direct Manipulation of Distant Objects Through SightWarpYang Liu, Thorbjørn Mikkelsen, Zehai Liu, Gengchen Tian et al.UIST 2025 · 3 citations
Builds on7
- Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive InteractionsSiyou Pei, Alexander Chen, Jaewook Lee, Yang ZhangCHI 2022 · 93 citations
- Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative SensemakingWeizhou Luo, Anke Lehmann, Hjalmar Widengren, Raimund DachseltCHI 2022 · 87 citations
- Embodied Axes: Tangible, Actuated Interaction for 3D Augmented Reality Data SpacesMaxime Cordeil, Benjamin Bach, Andrew Cunningham, Bastian Montoya et al.CHI 2020 · 63 citations
- Exploring Spatial UI Transition Mechanisms with Head-Worn Augmented RealityFeiyu Lu, Yan XuCHI 2022 · 52 citations
- Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual RealityZhen Li, Joannes Chan, Joshua Walton, Hrvoje Benko et al.CHI 2021 · 33 citations
Related papers
- Beyond the Phone: Exploring Phone-XR Integration through Multi-View Transitions for Real-World ApplicationsFengyuan Zhu, Xun Qian, Daniel Kalmar, Mahdi Tayarani et al.IEEE VR 2025 · 4 citations
- Spatial Context Switches During Knowledge Tasks in Extended RealityWolfgang Büschel, Verena Biener, Dieter SchmalstiegCHI 2026 · 1 citation
- A Qualitative Investigation of User Transitions and Frictions in Cross-Reality ApplicationsJulius von Willich, Frank Nelles, Wen-Jie Tseng, Jan Gugenheimer et al.CHI 2025 · 5 citations
- AniXDim: Integrating Cross-Dimensional Interaction into Desktop Character Animation WorkflowsHaihan Lin, Ye Pan, Nianlong Li, Wanjun Lv et al.IEEE VR 2026
- SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic ConnectionsYifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi et al.UIST 2021 · 143 citations
