Vipo: Spatial-Visual Programming with Functions for Robot-IoT Workflows
Gaoping Huang, Pawan S. Rao, Meng-Han Wu, Xun Qian, Shimon Y. Nof, Karthik Ramani, Alexander J. Quinn
Abstract
Mobile robots and IoT (Internet of Things) devices can increase productivity, but only if they can be programmed by workers who understand the domain. This is especially true in manufacturing. Visual programming in the spatial context of the operating environment can enable mental models at a familiar level of abstraction. However, spatial-visual programming is still in its infancy; existing systems lack IoT integration and fundamental constructs, such as functions, that are essential for code reuse, encapsulation, or recursive algorithms. We present Vipo, a spatial-visual programming system for robot-IoT workflows. Vipo was designed with input from managers at six factories using mobile robots. Our user study (n=22) evaluated efficiency, correctness, comprehensibility of spatial-visual programming with functions.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 3e56273c-7798-4ee9-87b1-65fb1b0c0afcCited by top-tier papers4
- Situated Live Programming for Human-Robot CollaborationEmmanuel Senft, Michael Hagenow, Robert G. Radwin, Michael R. Zinn et al.UIST 2021 · 19 citations
- Mobiot: Augmenting Everyday Objects into Moving IoT Devices Using 3D Printed Attachments Generated by DemonstrationAbul Al Arabi, Jiahao Li, Xiang 'Anthony' Chen, Jeeeun KimCHI 2022 · 14 citations
- Mimic: In-Situ Recording and Re-Use of Demonstrations to Support Robot TeleoperationKarthik Mahadevan, Yan Chen, Maya Cakmak, Anthony Tang et al.UIST 2022 · 6 citations
- GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot CommunicationYate Ge, Meiying Li, Xipeng Huang, Yuanda Hu et al.CHI 2025 · 4 citations
Related papers
- Understanding In-Situ Programming for Smart Home AutomationXiaoyi Liu, Yingtian Shi, Chun Yu, Cheng Gao et al.UbiComp 2023 · 17 citations
- LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of ThingsZhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu et al.CHI 2023 · 30 citations
- Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial ReasoningShengguang Wu, Xiaohan Wang, Yuhui Zhang, Hao Zhu et al.ICLR 2026 · 2 citations
- Exploring Co-located Collaborative Visual Programming of Industrial Robotic Workplaces in Handheld ARZdenek Materna, Michal Kapinus, Daniel Bambusek, Vítezslav Beran et al.CHI 2026 · 1 citation
- What's Left? Concept Grounding with Logic-Enhanced Foundation ModelsJoy Hsu, Jiayuan Mao, Joshua B. Tenenbaum, Jiajun WuNeurIPS 2023 · 54 citations
