AI-generated AR Reassembly Guidance from Disassembly Videos to Scaffold Everyday Repair
Wenjing Deng, Zhihao Yao, Xinhui Kang, Qirui Sun, Xintong Wu, Sisi He, Chenzhuo Xiang, Haipeng Mi
Abstract
Repair is a valuable yet challenging activity, especially when product manuals are missing or outdated. Augmented Reality (AR) has been widely explored for repair tasks, but most systems rely on CAD models or pre-constructed assets, which escalate authoring costs and constrain scalability. We introduce RePairAR, a system that leverages multimodal large language models (MLLMs) to generate interactive AR reassembly guidance derived directly from user-recorded egocentric disassembly videos. RePairAR deduces step-part-relation structures, reverses these for reassembly planning, and delivers the guidance through mixed-media AR visualizations. In a user study with repair novices, RePairAR significantly reduced perceived temporal demand compared to traditional how-to videos. Both media improved self-efficacy, with RePairAR providing greater gains. Follow-up interviews revealed the mechanisms behind these effects. We contribute a validated MLLM-driven pipeline and highlight design implications for scalable, situated support in everyday repair practices.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- From Structure to Semantics: Hypergraph-Based AR Assembly Guidance with LLM-Mediated NarrationXinda Liu, Bowei Zhang, Jiaju Xu, Jian Wu et al.IEEE VR 2026
- Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision ModelsAda Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do, Ryo SuzukiUIST 2025 · 12 citations
- CADReview: Automatically Reviewing CAD Programs with Error Detection and CorrectionJiali Chen, Xusen Hei, Hongfei Liu, Yuancheng Wei et al.ACL 2025
- AI-Powered Conversational Assistance in Augmented Reality for Multi-Step TasksJuliana H. Madritsch, Tomislav Duricic, Neven A. M. ElSayed, Simone Kopeinik et al.IEEE VR 2026 · 1 citation
- Role-Aware Virtual Agents for Navigational Interaction guided by a Multimodal Large Language ModelMinyoung Kim, Changyang Li, Cuong Nguyen, Lap-Fai YuSIGGRAPH 2026
