Making Learner Weakness Actionable for Learning from Demonstration with Novice Teachers
Yuqing Zhu, Matthew Howard
摘要
Learning from demonstration can be an effective way to teach robots task-oriented policies. However, in an interactive setting when demonstrations are limited by time or other budgetary constraints, it is challenging to find those that fix the learner's (remaining) errors. This is especially difficult for novice teachers: they may provide task-valid trajectories, often these fail to meaningfully improve the policy due to their lack of knowledge of learning mechanisms internal to the robot. This paper introduces CLASP (Collaborative Learning with Anchored State-space Partitions), which summarises the teaching process as a compact map of behavioural regions anchored in the teacher's own demonstrations. The map connects task failure to actionable changes to demonstrations by indicating what is going wrong in an intuitive way. It also enables difficulty-aware training that emphasises regions where learning is failing. Across diverse benchmarks, CLASP improves success by up to 20% over offline and interactive baselines under the same demonstration budget, improves robustness under distribution shift by 14–20%, and preserves behavioural diversity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Data Quality in Imitation LearningSuneel Belkhale, Yuchen Cui, Dorsa SadighNeurIPS 2023 · 被引用 135 次
- Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human DemonstrationsXiaogang Jia, Denis Blessing, Xinkai Jiang, Moritz Reuss 等ICLR 2024 · 被引用 48 次
- Reverse Forward Curriculum Learning for Extreme Sample and Demo EfficiencyStone Tao, Arth Shukla, Tse-kai Chan, Hao SuICLR 2024 · 被引用 6 次
- Robot-Gated Interactive Imitation Learning with Adaptive Intervention MechanismHaoyuan Cai, Zhenghao Peng, Bolei ZhouICML 2025
相关 Paper
- STRAP: Robot Sub-Trajectory Retrieval for Augmented Policy LearningMarius Memmel, Jacob Berg, Bingqing Chen, Abhishek Gupta 等ICLR 2025
- Active Fine-Tuning of Multi-Task PoliciesMarco Bagatella, Jonas Hübotter, Georg Martius, Andreas KrauseICML 2025
- Generalizable Coarse-to-Fine Robot Manipulation via Language-Aligned 3D KeypointsJianshu Hu, Lidi Wang, Shujia Li, Yunpeng Jiang 等ICLR 2026 · 被引用 6 次
- Robust Imitation of a Few Demonstrations with a Backwards ModelJung Yeon Park, Lawson L. S. WongNeurIPS 2022 · 被引用 21 次
- KISA: A Unified Keyframe Identifier and Skill Annotator for Long-Horizon Robotics DemonstrationsLongxin Kou, Fei Ni, Yan Zheng, Jinyi Liu 等ICML 2024 · 被引用 5 次
