Assistive Teaching of Motor Control Tasks to Humans
Megha Srivastava, Erdem Biyik, Suvir Mirchandani, Noah D. Goodman, Dorsa Sadigh
Abstract
Recent works on shared autonomy and assistive-AI technologies, such as assistive robot teleoperation, seek to model and help human users with limited ability in a fixed task. However, these approaches often fail to account for humans' ability to adapt and eventually learn how to execute a control task themselves. Furthermore, in applications where it may be desirable for a human to intervene, these methods may inhibit their ability to learn how to succeed with full self-control. In this paper, we focus on the problem of assistive teaching of motor control tasks such as parking a car or landing an aircraft. Despite their ubiquitous role in humans' daily activities and occupations, motor tasks are rarely taught in a uniform way due to their high complexity and variance. We propose an AI-assisted teaching algorithm that leverages skill discovery methods from reinforcement learning (RL) to (i) break down any motor control task into teachable skills, (ii) construct novel drill sequences, and (iii) individualize curricula to students with different capabilities. Through an extensive mix of synthetic and user studies on two motor control tasks -- parking a car with a joystick and writing characters from the Balinese alphabet -- we show that assisted teaching with skills improves student performance by around 40% compared to practicing full trajectories without skills, and practicing with individualized drills can result in up to 25% further improvement. Our source code is available at https://github.com/Stanford-ILIAD/teaching
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2e79ab35-06fe-4879-883b-48b35dfc9127Cited by top-tier papers2
- Generating Language Corrections for Teaching Physical Control TasksMegha Srivastava, Noah D. Goodman, Dorsa SadighICML 2023 · 5 citations
- Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap LocalizationAyano Hiranaka, Ya-Chuan Hsu, Stefanos Nikolaidis, Erdem Biyik et al.ICML 2026
Builds on6
- Dynamics-Aware Unsupervised Discovery of SkillsArchit Sharma, Shixiang Gu, Sergey Levine, Vikash Kumar et al.ICLR 2020 · 475 citations
- Explore, Discover and Learn: Unsupervised Discovery of State-Covering SkillsVictor Campos, Alexander Trott, Caiming Xiong, Richard Socher et al.ICML 2020 · 178 citations
- Option Discovery using Deep Skill ChainingAkhil Bagaria, George KonidarisICLR 2020 · 126 citations
- Reinforcement Learning for the Adaptive Scheduling of Educational ActivitiesJonathan Bassen, Bharathan Balaji, Michael Schaarschmidt, Candace Thille et al.CHI 2020 · 73 citations
- Discovering Motor Programs by Recomposing DemonstrationsTanmay Shankar, Shubham Tulsiani, Lerrel Pinto, Abhinav GuptaICLR 2020 · 58 citations
Related papers
- Human-AI Shared Control via Policy DissectionQuanyi Li, Zhenghao Peng, Haibin Wu, Lan Feng et al.NeurIPS 2022 · 16 citations
- Synthesizing Programmatic Policies that Inductively GeneralizeJeevana Priya Inala, Osbert Bastani, Zenna Tavares, Armando Solar-LezamaICLR 2020 · 54 citations
- Learning a family of motor skills from a single motion clipSeyoung Lee, Sunmin Lee, Yongwoo Lee, Jehee LeeSIGGRAPH 2021 · 35 citations
- Controllability-Aware Unsupervised Skill DiscoverySeohong Park, Kimin Lee, Youngwoon Lee, Pieter AbbeelICML 2023 · 62 citations
- Disentangled Unsupervised Skill Discovery for Efficient Hierarchical Reinforcement LearningJiaheng Hu, Zizhao Wang, Peter Stone, Roberto Martín-MartínNeurIPS 2024 · 21 citations
