DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots
Ruben Grandia, Farbod Farshidian, Espen Knoop, Christian Schumacher, Marco Hutter, Moritz Bächer
Abstract
Legged robots are designed to perform highly dynamic motions. However, it remains challenging for users to retarget expressive motions onto these complex systems. In this paper, we present a Differentiable Optimal Control (DOC) framework that facilitates the transfer of rich motions from either animals or animations onto these robots. Interfacing with either motion capture or animation data, we formulate retargeting objectives whose parameters make them agnostic to differences in proportions and numbers of degrees of freedom between input and robot. Optimizing these parameters over the manifold spanned by optimal state and control trajectories, we minimize the retargeting error. We demonstrate the utility and efficacy of our modeling by applying DOC to a Model-Predictive Control (MPC) formulation, showing retargeting results for a family of robots of varying proportions and mass distribution. With a hardware deployment, we further show that the retargeted motions are physically feasible, while MPC ensures that the robots retain their capability to react to unexpected disturbances.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 50f7734a-4507-41cb-8a78-dc96a24810eeCited by top-tier papers3
- CrossLoco: Human Motion Driven Control of Legged Robots via Guided Unsupervised Reinforcement LearningTianyu Li, Hyunyoung Jung, Matthew C. Gombolay, Yong Kwon Cho et al.ICLR 2024 · 14 citations
- Differentiable Model Predictive Control on the GPUEmre Adabag, Marcus Greiff, John Subosits, Thomas Jonathan LewICLR 2026 · 13 citations
- ReActor: Reinforcement Learning for Physics-Aware Motion RetargetingDavid Müller, Agon Serifi, Sammy Christen, Ruben Grandia et al.SIGGRAPH 2026
Builds on3
- ASE: large-scale reusable adversarial skill embeddings for physically simulated charactersXue Bin Peng, Yunrong Guo, Lina Halper, Sergey Levine et al.SIGGRAPH 2022 · 217 citations
- Physics-based character controllers using conditional VAEsJungdam Won, Deepak Gopinath, Jessica K. HodginsSIGGRAPH 2022 · 95 citations
- Learning a family of motor skills from a single motion clipSeyoung Lee, Sunmin Lee, Yongwoo Lee, Jehee LeeSIGGRAPH 2021 · 35 citations
Related papers
- ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual LearningKailin Li, Puhao Li, Tengyu Liu, Yuyang Li et al.CVPR 2025
- H-GAP: Humanoid Control with a Generalist PlannerZhengyao Jiang, Yingchen Xu, Nolan Wagener, Yicheng Luo et al.ICLR 2024 · 15 citations
- From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent GuidanceZhe Li, Yangyang Wei, Boan Zhu, Yibo Peng et al.ICLR 2026 · 29 citations
- Semantics-Aware Motion Retargeting with Vision-Language ModelsHaodong Zhang, Zhike Chen, Haocheng Xu, Lei Hao et al.CVPR 2024 · 8 citations
- Unlocking Efficient Vehicle Dynamics Modeling via Analytic World ModelsAsen Nachkov, Danda Pani Paudel, Jan-Nico Zaech, Davide Scaramuzza et al.AAAI 2026 · 2 citations
