ProInterAR: A Visual Programming Platform for Creating Immersive AR Interactions
Hui Ye, Jiaye Leng, Pengfei Xu, Karan Singh, Hongbo Fu
Abstract
AR applications commonly contain diverse interactions among different AR contents. Creating such applications requires creators to have advanced programming skills for scripting interactive behaviors of AR contents, repeated transferring and adjustment of virtual contents from virtual to physical scenes, testing by traversing between desktop interfaces and target AR scenes, and digitalizing AR contents. Existing immersive tools for prototyping/authoring such interactions are tailored for domain-specific applications. To support programming general interactive behaviors of real object(s)/environment(s) and virtual object(s)/environment(s) for novice AR creators, we propose ProInterAR, an integrated visual programming platform to create immersive AR applications with a tablet and an AR-HMD. Users can construct interaction scenes by creating virtual contents and augmenting real contents from the view of an AR-HMD, script interactive behaviors by stacking blocks from a tablet UI, and then execute and control the interactions in the AR scene. We showcase a wide range of AR application scenarios enabled by ProInterAR, including AR game, AR teaching, sequential animation, AR information visualization, etc. Two usability studies validate that novice AR creators can easily program various desired AR applications using ProInterAR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8fbca530-4bcd-423d-b14e-d40c60c50ee3Cited by top-tier papers3
- InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMsZhongyi Zhou, Jing Jin, Vrushank Phadnis, Xiuxiu Yuan et al.CHI 2025 · 10 citations
- EchoSight: Streamlining Bidirectional Virtual-physical Interaction with In-situ Optical TetheringJingyu Li, Qingwen Yang, Kenuo Xu, Yang Zhang et al.CHI 2025 · 4 citations
- Empowering Children to Create AI-Enabled Augmented Reality ExperiencesLei Zhang, Shuyao Zhou, Amna Liaqat, Tinney Mak et al.UIST 2025 · 1 citation
Builds on16
- Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and OpportunitiesNarges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling et al.CHI 2020 · 274 citations
- Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application DevelopmentVeronika Krauß, Alexander Boden, Leif Oppermann, René ReinersCHI 2021 · 132 citations
- RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic SketchingRyo Suzuki, Rubaiat Habib Kazi, Li-Yi Wei, Stephen DiVerdi et al.UIST 2020 · 98 citations
- Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionGermán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, Paul AsenteCHI 2020 · 96 citations
- FlowMatic: An Immersive Authoring Tool for Creating Interactive Scenes in Virtual RealityLei Zhang, Steve OneyUIST 2020 · 95 citations
Related papers
- CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware ApplicationsTianyi Wang, Xun Qian, Fengming He, Xiyun Hu et al.UIST 2020 · 72 citations
- XRDirector: A Role-Based Collaborative Immersive Authoring SystemMichael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu et al.CHI 2020 · 80 citations
- Comparative Analysis of AR, VR, and Desktop Tools for Prototyping Augmented Reality ServicesJérémy Lacoche, Anthony Foulonneau, Stéphane Louis Dit PicardIEEE VR 2025 · 4 citations
- MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-timeZhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang et al.UIST 2022 · 20 citations
- Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine TeachingKyzyl Monteiro, Ritik Vatsal, Neil Chulpongsatorn, Aman Parnami et al.CHI 2023 · 55 citations
