Stage Conscious Attention Network (SCAN): A Demonstration-Conditioned Policy for Few-Shot Imitation
Jia-Fong Yeh, Chi-Ming Chung, Hung-Ting Su, Yi-Ting Chen, Winston H. Hsu
Abstract
In few-shot imitation learning (FSIL), using behavioral cloning (BC) to solve unseen tasks with few expert demonstrations becomes a popular research direction. The following capabilities are essential in robotics applications: (1) Behaving in compound tasks that contain multiple stages. (2) Retrieving knowledge from few length-variant and misalignment demonstrations. (3) Learning from an expert different from the agent. No previous work can achieve these abilities at the same time. In this work, we conduct FSIL problem under the union of above settings and introduce a novel stage conscious attention network (SCAN) to retrieve knowledge from few demonstrations simultaneously. SCAN uses an attention module to identify each stage in length-variant demonstrations. Moreover, it is designed under demonstration-conditioned policy that learns the relationship between experts and agents. Experiment results show that SCAN can perform in complicated compound tasks without fine-tuning and provide the explainable visualization. Project page is at https://sites.google.com/view/scan-aaai2022.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- AED: Adaptable Error Detection for Few-shot Imitation PolicyJia-Fong Yeh, Kuo-Han Hung, Pang-Chi Lo, Chi-Ming Chung et al.NeurIPS 2024 · 3 citations
- Deep Demonstration Tracing: Learning Generalizable Imitator Policy for Runtime Imitation from a Single DemonstrationXiong-Hui Chen, Junyin Ye, Hang Zhao, Yi-Chen Li et al.ICML 2024 · 2 citations
Builds on5
- SQIL: Imitation Learning via Reinforcement Learning with Sparse RewardsSiddharth Reddy, Anca D. Dragan, Sergey LevineICLR 2020 · 299 citations
- Few-Shot Bayesian Imitation Learning with Logical Program PoliciesTom Silver, Kelsey R. Allen, Alex K. Lew, Leslie Pack Kaelbling et al.AAAI 2020 · 57 citations
- Demonstration-Conditioned Reinforcement Learning for Few-Shot ImitationChristopher R. Dance, Julien Perez, Théo CachetICML 2021 · 17 citations
- StarNet: towards Weakly Supervised Few-Shot Object DetectionLeonid Karlinsky, Joseph Shtok, Amit Alfassy, Moshe Lichtenstein et al.AAAI 2021 · 17 citations
- Learning Compound Tasks without Task-specific Knowledge via Imitation and Self-supervised LearningSang-Hyun Lee, Seung-Woo SeoICML 2020 · 12 citations
Related papers
- Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous ControlSeongwoong Cho, Donggyun Kim, Jinwoo Lee, Seunghoon HongNeurIPS 2024 · 6 citations
- Active Fine-Tuning of Multi-Task PoliciesMarco Bagatella, Jonas Hübotter, Georg Martius, Andreas KrauseICML 2025
- Hierarchical Few-Shot Imitation with Skill Transition ModelsKourosh Hakhamaneshi, Ruihan Zhao, Albert Zhan, Pieter Abbeel et al.ICLR 2022 · 51 citations
- PIRLNav: Pretraining with Imitation and RL Finetuning for OBJECTNAVRam Ramrakhya, Dhruv Batra, Erik Wijmans, Abhishek DasCVPR 2023
- A Smooth Sea Never Made a Skilled SAILOR: Robust Imitation via Learning to SearchArnav Kumar Jain, Vibhakar Mohta, Subin Kim, Atiksh Bhardwaj et al.NeurIPS 2025 · 27 citations
