UnMapped: Leveraging Experts' Situated Experiences to Ease Remote Guidance in Collaborative Mixed Reality
Janet G. Johnson, Tommy Sharkey, Iramuali Cynthia Butarbutar, Danica Xiong, Ruijie Huang, Lauren Sy, Nadir Weibel
Abstract
Collaborative Mixed Reality (MR) systems that help extend expertise for physical tasks to remote environments often situate experts in an immersive view of the task environment to bring the collaboration closer to collocated settings. In this paper, we design UnMapped, an alternative interface for remote experts that combines a live 3D view of the active space within the novice’s environment with a static 3D recreation of the expert’s own workspace to leverage their existing spatial memories within it. We evaluate the impact of this approach on single and repeated use of collaborative MR systems for remote guidance through a comparative study. Our results indicate that despite having a limited understanding of the novice’s environment, using an UnMapped interface increased performance and communication efficiency while reducing experts’ task load. We also outline the various affordances of providing remote experts with a familiar and spatially-stable environment to assist novices.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 1fd437bf-fe6b-4d98-a05b-c7c8b917804aCited by top-tier papers7
- Exploring Collaborative GenAI Agents in Synchronous Group Settings: Eliciting Team Perceptions and Design Considerations for the Future of WorkJanet G. Johnson, Macarena Peralta, Mansanjam Kaur, Ruijie Sophia Huang et al.CSCW 2025 · 16 citations
- Thing2Reality: Enabling Spontaneous Creation of 3D Objects from 2D Content using Generative AI in XR MeetingsErzhen Hu, Mingyi Li, Jungtaek Hong, Xun Qian et al.UIST 2025 · 13 citations
- Practice-informed Patterns for Organising Large Groups in Distributed Mixed Reality CollaborationEmily Wong, Juan Sánchez Esquivel, Germán Leiva, Jens Emil Sloth Grønbæk et al.CHI 2024 · 11 citations
- A Systematic Literature Review to Characterize Asymmetric Interaction in Collaborative SystemsVictor Bréhault, Emmanuel Dubois, Arnaud Prouzeau, Marcos SerranoCHI 2025 · 9 citations
- Seeing Eye to Eye: Enabling Cognitive Alignment Through Shared First-Person Perspective in Human-AI Collaboration: Seeing Eye to EyeZhuyu Teng, Pei Chen, Yichen Cai, Ruoqing Lu et al.CHI 2026 · 2 citations
Related papers
- Do You Really Need to Know Where "That" Is? Enhancing Support for Referencing in Collaborative Mixed Reality EnvironmentsJanet G. Johnson, Danilo Gasques, Tommy Sharkey, Evan Schmitz et al.CHI 2021 · 28 citations
- Using Virtual Replicas to Improve Mixed Reality Remote CollaborationHuayuan Tian, Gun A. Lee, Huidong Bai, Mark BillinghurstIEEE VR 2023 · 57 citations
- Duplicated Reality for Co-located Augmented Reality CollaborationKevin Yu, Ulrich Eck, Frieder Pankratz, Marc Lazarovici et al.IEEE VR 2022 · 53 citations
- SurfShare: Lightweight Spatially Consistent Physical Surface and Virtual Replica Sharing with Head-mounted Mixed-RealityXincheng Huang, Robert XiaoUbiComp 2024 · 18 citations
- A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture SharingHuidong Bai, Prasanth Sasikumar, Jing Yang, Mark BillinghurstCHI 2020 · 210 citations
