AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality
Gaoping Huang, Xun Qian, Tianyi Wang, Fagun Patel, Maitreya Sreeram, Yuanzhi Cao, Karthik Ramani, Alexander J. Quinn
Abstract
Modern manufacturing processes are in a state of flux, as they adapt to increasing demand for flexible and self-configuring production. This poses challenges for training workers to rapidly master new machine operations and processes, i.e. machine tasks. Conventional in-person training is effective but requires time and effort of experts for each worker trained and not scalable. Recorded tutorials, such as video-based or augmented reality (AR), permit more efficient scaling. However, unlike in-person tutoring, existing recorded tutorials lack the ability to adapt to workers’ diverse experiences and learning behaviors. We present AdapTutAR, an adaptive task tutoring system that enables experts to record machine task tutorials via embodied demonstration and train learners with different AR tutoring contents adapting to each user’s characteristics. The adaptation is achieved by continually monitoring learners’ tutorial-following status and adjusting the tutoring content on-the-fly and in-situ. The results of our user study evaluation have demonstrated that our adaptive system is more effective and preferable than the non-adaptive one.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c538a744-5481-4b8a-bbb7-84c0a6b386c7Cited by top-tier papers30
- Design Patterns for Situated Visualization in Augmented RealityBenjamin Lee, Michael Sedlmair, Dieter SchmalstiegIEEE VIS 2023 · 72 citations
- ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on ClassroomsMehrad Faridan, Bheesha Kumari, Ryo SuzukiCHI 2023 · 29 citations
- InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied DemonstrationZiyi Liu, Zhengzhe Zhu, Enze Jiang, Feichi Huang et al.CHI 2023 · 29 citations
- Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone ApplicationsXiaofu Jin, Wai Tong, Xiaoying Wei, Xian Wang et al.CHI 2024 · 25 citations
- PrISM-Tracker: A Framework for Multimodal Procedure Tracking Using Wearable Sensors and State Transition Information with User-Driven Handling of Errors and UncertaintyRiku Arakawa, Hiromu Yakura, Vimal Mollyn, Suzanne Nie et al.UbiComp 2023 · 20 citations
Builds on3
- Utilizing VR and Gaze Tracking to Develop AR Solutions for Industrial MaintenanceAlisa Burova, John Mäkelä, Jaakko Hakulinen, Tuuli Keskinen et al.CHI 2020 · 76 citations
- An Exploratory Study of Augmented Reality Presence for Tutoring Machine TasksYuanzhi Cao, Xun Qian, Tianyi Wang, Rachel Lee et al.CHI 2020 · 73 citations
- Design and Evaluation of a VR Training Simulation for Pump Maintenance Based on a Use Case at GrundfosFrederik Winther, Linoj Ravindran, Kasper Paabøl Svendsen, Tiare M. FeuchtnerIEEE VR 2020 · 10 citations
Related papers
- WELDAR: Augmenting Live Hands-On Training with In-Situ Guidance for Novice LearnersChuhan (Franklin) Xu, Lia Sparingga Purnamasari, Zhenfang Chen, Daragh Byrne et al.CHI 2026 · 1 citation
- ARify: Leveraging Narrated Instructional Videos to Create Augmented Reality Tutorials for Procedural TasksXiyun Hu, Chenfei Zhu, Shao-Kang Hsia, Dizhi Ma et al.CHI 2026 · 1 citation
- Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor CuesJiannan Li, Maurício Sousa, Karthik Mahadevan, Bryan Wang et al.CHI 2023 · 12 citations
- Task Breakpoint Generation using Origin-Centric Graph in Virtual Reality Recordings for Adaptive PlaybackSelin Choi, Dooyoung Kim, Taewook Ha, Seonji Kim et al.IEEE VR 2026
- Do It Fast, Forget It Fast: How Timing and Limb Visualizations Affect First-Person Augmented Reality InstructionsClara Sayffaerth, Ehbal Ablimit, Annika Köhler, Jonas Wombacher et al.CHI 2026 · 1 citation
