Lune

CVPR2024Top-tier venue

CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation

Jun Wang, Yuzhe Qin, Kaiming Kuang, Yigit Korkmaz, Akhilan Gurumoorthy, Hao Su, Xiaolong Wang

Abstract

We introduce CyberDemo, a novel approach to robotic imitation learning that leverages simulated human demonstrations for real-world tasks. By incorporating extensive data augmentation in a simulated environment, CyberDemo outperforms traditional in-domain real-world demonstrations when transferred to the real world, handling diverse physical and visual conditions. Regardless of its affordability and convenience in data collection, CyberDemo outperforms baseline methods in terms of success rates across various tasks and exhibits generalizability with previously unseen objects. For example, it can rotate novel tetra-valve and penta-valve, despite human demonstrations only involving tri-valves. Our research demonstrates the significant potential of simulated human demonstrations for realworld dexterous manipulation tasks. More details can be found at https://cyber-demo.github.io/

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

5 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Emerging Properties in Self-Supervised Vision Transformers cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  • Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robots cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  • RoboPearls: Editable Video Simulation for Robot Manipulation cites Ego4D: Around the World in 3, 000 Hours of Egocentric Video
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers5

  1. Manipulation as in Simulation: Enabling Accurate Geometry Perception in RobotsMinghuan Liu, Zhengbang Zhu, Xiaoshen Han, Peng Hu et al.ICLR 2026 · 17 citations
  2. RoboPearls: Editable Video Simulation for Robot ManipulationTang Tao, Likui Zhang, Youpeng Wen, Kaidong Zhang et al.ICCV 2025 · 4 citations
  3. BimArt: A Unified Approach for the Synthesis of 3D Bimanual Interaction with Articulated ObjectsWanyue Zhang, Rishabh Dabral, Vladislav Golyanik, Vasileios Choutas et al.CVPR 2025
  4. ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual LearningKailin Li, Puhao Li, Tengyu Liu, Yuyang Li et al.CVPR 2025
  5. Video2Robo: 3DGS-based Synthetic Data from One Video Enables Scalable Robot LearningYinan Deng, Kejia Hu, Ye Chen, Jianyu Dou et al.CVPR 2026

Builds on17

  1. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
  2. Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
  3. Habitat: A Platform for Embodied AI ResearchManolis Savva, Jitendra Malik, Devi Parikh, Dhruv Batra et al.ICCV 2019 · 1,863 citations
  4. Ego4D: Around the World in 3, 000 Hours of Egocentric VideoKristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis et al.CVPR 2022 · 525 citations
  5. Decoupling Representation Learning from Reinforcement LearningAdam Stooke, Kimin Lee, Pieter Abbeel, Michael LaskinICML 2021 · 389 citations

Related papers

  1. DemoGrasp: Universal Dexterous Grasping from a Single DemonstrationHaoqi Yuan, Ziye Huang, Ye Wang, Chuan Mao et al.ICLR 2026 · 14 citations
  2. Meta-Imitation Learning by Watching Video DemonstrationsJiayi Li, Tao Lu, Xiaoge Cao, Yinghao Cai et al.ICLR 2022 · 25 citations
  3. DexNDM: Closing the Reality Gap for Dexterous In-Hand Rotation via Joint-Wise Neural Dynamics ModelXueyi Liu, He Wang, Li YiICLR 2026 · 26 citations
  4. AdaManip: Adaptive Articulated Object Manipulation Environments and Policy LearningYuanfei Wang, Xiaojie Zhang, Ruihai Wu, Yu Li et al.ICLR 2025
  5. M^3A Policy: Mutable Material Manipulation Augmentation Policy through Photometric Re-renderingJiayi Li, Yuxuan Hu, Haoran Geng, Xiangyu Chen, Chuhao Zhou, Ziteng Cui, Jianfei YangCVPR Findings 2026 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines