XRDirector: A Role-Based Collaborative Immersive Authoring System
Michael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu, Michelle Chung, Piaoyang Wang, Janet Nebeling
Abstract
Immersive authoring is an increasingly popular technique to design AR/VR scenes because design and testing can be done concurrently. Most existing systems, however, are single-user and limited to either AR or VR, thus constrained in the interaction techniques. We present XRDirector, a role-based collaborative immersive authoring system that enables designers to freely express interactions using AR and VR devices as puppets to manipulate virtual objects in 3D physical space. In XRDirector, we adapt roles known from filmmaking to structure the authoring process and help coordinate multiple designers in immersive authoring tasks. We study how novice AR/VR creators can take advantage of the roles and modes in XRDirector to prototype complex scenes with animated 3D characters, light effects, and camera movements, and also simulate interactive system behavior in a Wizard of Oz style. XRDirector's design was informed by case studies around complex 3D movie scenes and AR/VR games, as well as workshops with novice AR/VR creators. We show that XRDirector makes it easier and faster to create AR/VR scenes without the need for coding, characterize the issues in coordinating designers between AR and VR, and identify the strengths and weaknesses of each role and mode to mitigate the issues.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers21
- Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application DevelopmentVeronika Krauß, Alexander Boden, Leif Oppermann, René ReinersCHI 2021 · 132 citations
- ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual RealityXun Qian, Fengming He, Xiyun Hu, Tianyi Wang et al.CHI 2022 · 69 citations
- VRception: Rapid Prototyping of Cross-Reality Systemsin Virtual RealityUwe Gruenefeld, Jonas Auda, Florian Mathis, Stefan Schneegass et al.CHI 2022 · 66 citations
- XRStudio: A Virtual Production and Live Streaming System for Immersive Instructional ExperiencesMichael Nebeling, Shwetha Rajaram, Liwei Wu, Yifei Cheng et al.CHI 2021 · 64 citations
- Rapido: Prototyping Interactive AR Experiences through Programming by DemonstrationGermán Leiva, Jens Emil Grønbæk, Clemens Nylandsted Klokmose, Cuong Nguyen et al.UIST 2021 · 58 citations
Related papers
- ProInterAR: A Visual Programming Platform for Creating Immersive AR InteractionsHui Ye, Jiaye Leng, Pengfei Xu, Karan Singh et al.CHI 2024 · 10 citations
- Physicality As an Anchor for Coordination: Examining Collocated Collaboration in Physical and Mobile Augmented Reality SettingsLev Poretski, Joel Lanir, Ram Margalit, Ofer ArazyCSCW 2021 · 15 citations
- Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionGermán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, Paul AsenteCHI 2020 · 96 citations
- MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-timeZhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang et al.UIST 2022 · 20 citations
- AudioMiXR: Spatial Audio Object Manipulation with 6DoF for Sound Design in Augmented RealityBrandon J. Woodard, Margarita Geleta, Joseph J. LaViola, Andrea Fanelli et al.UbiComp 2025 · 4 citations
