LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things
Zhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu, Joey Huang, Ana M. Villanueva, Xun Qian, Kylie Peppler, Karthik Ramani
Abstract
The rapid growth of Internet-of-Things (IoT) applications has generated interest from many industries and a need for graduates with relevant knowledge. An IoT system is comprised of spatially distributed interactions between humans and various interconnected IoT components. These interactions are contextualized within their ambient environment, thus impeding educators from recreating authentic tasks for hands-on IoT learning. We propose LearnIoTVR, an end-to-end virtual reality (VR) learning environment which helps students to acquire IoT knowledge through immersive design, programming, and exploration of real-world environments empowered by IoT (e.g., a smart house). The students start the learning process by installing virtual IoT components we created in different locations inside the VR environment so that the learning will be situated in the same context where the IoT is applied. With our custom-designed 3D block-based language, students can program IoT behaviors directly within VR and get immediate feedback on their programming outcome. In the user study, we evaluated the learning outcomes among students using LearnIoTVR with a pre- and post-test to understand to what extent does engagement in LearnIoTVR lead to gains in learning programming skills and IoT competencies. Additionally, we examined what aspects of LearnIoTVR support usability and learning of programming skills compared to a traditional desktop-based learning environment. The results from these studies were promising. We also acquired insightful user feedback which provides inspiration for further expansions of this system.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5ae272d6-d850-4113-a2f4-37cd7578008fCited by top-tier papers6
- VRCopilot: Authoring 3D Layouts with Generative AI Models in VRLei Zhang, Jin Pan, Jacob Gettig, Steve Oney et al.UIST 2024 · 53 citations
- ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom ParticipationZiyi Liu, Zhengzhe Zhu, Lijun Zhu, Enze Jiang et al.CHI 2024 · 50 citations
- CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial IntelligenceJingyu Shi, Rahul Jain, Seunggeun Chi, Hyungjun Doh et al.CHI 2025 · 19 citations
- Jigsaw: Authoring Immersive Storytelling Experiences with Augmented Reality and Internet of ThingsLei Zhang, Daekun Kim, Youjean Cho, Ava Robinson et al.CHI 2024 · 17 citations
- ProInterAR: A Visual Programming Platform for Creating Immersive AR InteractionsHui Ye, Jiaye Leng, Pengfei Xu, Karan Singh et al.CHI 2024 · 10 citations
Builds on8
- Investigating Representation of Text and Audio in Educational VR using Learning Outcomes and EEGSarune Baceviciute, Aske Mottelson, Thomas Terkildsen, Guido MakranskyCHI 2020 · 79 citations
- Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM ClassroomsAna M. Villanueva, Zhengzhe Zhu, Ziyi Liu, Kylie Peppler et al.CHI 2020 · 76 citations
- CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware ApplicationsTianyi Wang, Xun Qian, Fengming He, Xiyun Hu et al.UIST 2020 · 72 citations
- Digital Transformations of Classrooms in Virtual RealityHong Gao, Efe Bozkir, Lisa Hasenbein, Jens-Uwe Hahn et al.CHI 2021 · 69 citations
- Embodied Learning in Immersive Smart SpacesMirko Gelsomini, Giulia Leonardi, Franca GarzottoCHI 2020 · 42 citations
Related papers
- StoryMakAR: Bringing Stories to Life With An Augmented Reality & Physical Prototyping Toolkit for YouthTerrell Glenn, Ananya Ipsita, Caleb Carithers, Kylie Peppler et al.CHI 2020 · 58 citations
- TinyLink 2.0: integrating device, cloud, and client development for IoT applicationsGaoyang Guan, Borui Li, Yi Gao, Yuxuan Zhang et al.MobiCom 2020 · 17 citations
- Understanding In-Situ Programming for Smart Home AutomationXiaoyi Liu, Yingtian Shi, Chun Yu, Cheng Gao et al.UbiComp 2023 · 17 citations
- Vipo: Spatial-Visual Programming with Functions for Robot-IoT WorkflowsGaoping Huang, Pawan S. Rao, Meng-Han Wu, Xun Qian et al.CHI 2020 · 31 citations
- Perceive, Adapt, and Interact: An Intelligent Virtual Agent for Education in Mixed RealityNaveed Ahmed, Zulaiha Afrah Sadakathullah Shaduly, Mohammed Lataifeh, Imad AfyouniIEEE VR 2026
