MineXR: Mining Personalized Extended Reality Interfaces
Hyunsung Cho, Yukang Yan, Kashyap Todi, Mark Parent, Missie Smith, Tanya R. Jonker, Hrvoje Benko, David Lindlbauer
Abstract
Extended Reality (XR) interfaces offer engaging user experiences, but their effective design requires a nuanced understanding of user behavior and preferences. This knowledge is challenging to obtain without the widespread adoption of XR devices. We introduce MineXR, a design mining workflow and data analysis platform for collecting and analyzing personalized XR user interaction and experience data. MineXR enables elicitation of personalized interfaces from participants of a data collection: for any particular context, participants create interface elements using application screenshots from their own smartphone, place them in the environment, and simultaneously preview the resulting XR layout on a headset. Using MineXR, we contribute a dataset of personalized XR interfaces collected from 31 participants, consisting of 695 XR widgets created from 178 unique applications. We provide insights for XR widget functionalities, categories, clusters, UI element types, and placement. Our open-source tools and data support researchers and designers in developing future XR interfaces.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e8014a96-5fc5-492a-8527-159786d7e8daCited by top-tier papers6
- SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM ReasoningZhipeng Li, Christoph Gebhardt, Yves Inglin, Nicolas Steck et al.UIST 2024 · 36 citations
- Auptimize: Optimal Placement of Spatial Audio Cues for Extended RealityHyunsung Cho, Alexander Wang, Divya Kartik, Emily Liying Xie et al.UIST 2024 · 19 citations
- Evaluating Dynamic Delivery of Audio+Visual Message Notifications in XRHyunsung Cho, Drew Edgar, David Lindlbauer, Joseph O'HaganIEEE VR 2025 · 13 citations
- Automating UI Optimization through Multi-Agentic ReasoningZhipeng Li, Christoph Gebhardt, Yi-Chi Liao, Christian HolzCHI 2026 · 1 citation
- Spatial Context Switches During Knowledge Tasks in Extended RealityWolfgang Büschel, Verena Biener, Dieter SchmalstiegCHI 2026 · 1 citation
Builds on26
- Enabling Conversational Interaction with Mobile UI using Large Language ModelsBryan Wang, Gang Li, Yang LiCHI 2023 · 149 citations
- DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented RealityRuofei Du, Eric Turner, Maksym Dzitsiuk, Luca Prasso et al.UIST 2020 · 145 citations
- Screen Recognition: Creating Accessibility Metadata for Mobile Applications from PixelsXiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White et al.CHI 2021 · 145 citations
- SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic ConnectionsYifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi et al.UIST 2021 · 143 citations
- AUIT - the Adaptive User Interfaces Toolkit for Designing XR ApplicationsJoão Marcelo Evangelista Belo, Mathias N. Lystbæk, Anna Maria Feit, Ken Pfeuffer et al.UIST 2022 · 114 citations
Related papers
- PLUME: Record, Replay, Analyze and Share User Behavior in 6DoF XR ExperiencesCharles Javerliat, Sophie Villenave, Pierre Raimbaud, Guillaume LavouéIEEE VR 2024 · 35 citations
- GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI DesignArthur Caetano, Yunhao Luo, Adwait Sharma, Misha SraUIST 2025 · 1 citation
- UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self EntitiesSiyou Pei, David Kim, Alex Olwal, Yang Zhang et al.CHI 2024 · 19 citations
- Privacy in Immersive Extended Reality: Exploring User Perceptions, Concerns, and Coping StrategiesHilda Hadan, Derrick M. Wang, Lennart E. Nacke, Leah Zhang-KennedyCHI 2024 · 36 citations
- Look Before You Leap: Context-Sensitive GUI Grounding for Boosting Automated Extended Reality (XR) TestingShuqing Li, Binchang Li, Yepang Liu, Cuiyun Gao et al.FSE 2026
