CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications
Tianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Ke Huo, Yuanzhi Cao, Karthik Ramani
Abstract
Recognition of human behavior plays an important role in context-aware applications. However, it is still a challenge for end-users to build personalized applications that accurately recognize their own activities. Therefore, we present CAPturAR, an in-situ programming tool that supports users to rapidly author context-aware applications by referring to their previous activities. We customize an AR head-mounted device with multiple camera systems that allow for non-intrusive capturing of user's daily activities. During authoring, we reconstruct the captured data in AR with an animated avatar and use virtual icons to represent the surrounding environment. With our visual programming interface, users create human-centered rules for the applications and experience them instantly in AR. We further demonstrate four use cases enabled by CAPturAR. Also, we verify the effectiveness of the AR-HMD and the authoring workflow with a system evaluation using our prototype. Moreover, we conduct a remote user study in an AR simulator to evaluate the usability.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers30
- Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesRyo Suzuki, Adnan Karim, Tian Xia, Hooman Hedayati et al.CHI 2022 · 243 citations
- GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality ApplicationsTianyi Wang, Xun Qian, Fengming He, Xiyun Hu et al.UIST 2021 · 75 citations
- Design Patterns for Situated Visualization in Augmented RealityBenjamin Lee, Michael Sedlmair, Dieter SchmalstiegIEEE VIS 2023 · 72 citations
- ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual RealityXun Qian, Fengming He, Xiyun Hu, Tianyi Wang et al.CHI 2022 · 69 citations
- Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine TeachingKyzyl Monteiro, Ritik Vatsal, Neil Chulpongsatorn, Aman Parnami et al.CHI 2023 · 55 citations
Related papers
- ProInterAR: A Visual Programming Platform for Creating Immersive AR InteractionsHui Ye, Jiaye Leng, Pengfei Xu, Karan Singh et al.CHI 2024 · 10 citations
- CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial IntelligenceJingyu Shi, Rahul Jain, Seunggeun Chi, Hyungjun Doh et al.CHI 2025 · 19 citations
- CoCreatAR: Enhancing Authoring of Outdoor Augmented Reality Experiences Through Asymmetric CollaborationNels Numan, Gabriel J. Brostow, Suhyun Park, Simon Julier et al.CHI 2025 · 12 citations
- Empowering Children to Create AI-Enabled Augmented Reality ExperiencesLei Zhang, Shuyao Zhou, Amna Liaqat, Tinney Mak et al.UIST 2025 · 1 citation
- Story CreatAR: a Toolkit for Spatially-Adaptive Augmented Reality StorytellingAbbey Singh, Ramanpreet Kaur, Peter Haltner, Matthew Peachey et al.IEEE VR 2021 · 16 citations
