Contact-Aware Retargeting of Skinned Motion
Ruben Villegas, Duygu Ceylan, Aaron Hertzmann, Jimei Yang, Jun Saito
Abstract
This paper introduces a motion retargeting method that preserves self-contacts and prevents interpenetration. Self-contacts, such as when hands touch each other or the torso or the head, are important attributes of human body language and dynamics, yet existing methods do not model or preserve these contacts. Likewise, interpenetration, such as a hand passing into the torso, are a typical artifact of motion estimation methods. The input to our method is a human motion sequence and a target skeleton and character geometry. The method identifies self-contacts and ground contacts in the input motion, and optimizes the motion to apply to the output skeleton, while preserving these contacts and reducing interpenetration. We introduce a novel geometry-conditioned recurrent network with an encoder-space optimization strategy that achieves efficient retargeting while satisfying contact constraints. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works. We also show our method generalizes to motion estimated from human videos where we improve over previous works that produce noticeable interpenetration.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 84530d1d-2e86-4275-b482-b1059004d48eCited by top-tier papers15
- Action-conditioned On-demand Motion GenerationQiujing Lu, Yipeng Zhang, Mingjian Lu, Vwani RoychowdhuryACM MM 2022 · 29 citations
- LAC - Latent Action Composition for Skeleton-based Action SegmentationDi Yang, Yaohui Wang, Antitza Dantcheva, Quan Kong et al.ICCV 2023 · 22 citations
- Skinned Motion Retargeting with Dense Geometric Interaction PerceptionZijie Ye, Jia-Wei Liu, Jia Jia, Shikun Sun et al.NeurIPS 2024 · 22 citations
- UnifiedGesture: A Unified Gesture Synthesis Model for Multiple SkeletonsSicheng Yang, Zilin Wang, Zhiyong Wu, Minglei Li et al.ACM MM 2023 · 17 citations
- AnyTop: Character Animation Diffusion with Any TopologyInbar Gat, Sigal Raab, Guy Tevet, Yuval Reshef et al.SIGGRAPH 2025 · 9 citations
Builds on5
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
- Resolving 3D Human Pose Ambiguities With 3D Scene ConstraintsMohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, Michael J. BlackICCV 2019 · 384 citations
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung et al.SIGGRAPH 2020 · 210 citations
- Generating 3D People in Scenes Without PeopleYan Zhang, Mohamed Hassan, Heiko Neumann, Michael J. Black et al.CVPR 2020
- On Self-Contact and Human PoseLea Müller, Ahmed A. A. Osman, Siyu Tang, Chun-Hao P. Huang et al.CVPR 2021
Related papers
- Skinned Motion Retargeting with Spatially Adaptive Interaction GuidanceSoojin Choi, Seokhyeon Hong, Chaelin Kim, Junghyun Nam et al.SIGGRAPH 2026
- Skinned Motion Retargeting with Residual Perception of Motion Semantics & GeometryJiaxu Zhang, Junwu Weng, Di Kang, Fang Zhao et al.CVPR 2023
- STaR: Seamless Spatial-Temporal Aware Motion Retargeting with Penetration and Consistency ConstraintsXiaohang Yang, Qing Wang, Jiahao Yang, Gregory G. Slabaugh et al.ICCV 2025 · 2 citations
- Simulation and Retargeting of Complex Multi-Character InteractionsYunbo Zhang, Deepak Gopinath, Yuting Ye, Jessica K. Hodgins et al.SIGGRAPH 2023 · 25 citations
- Semantics2Hands: Transferring Hand Motion Semantics between AvatarsZijie Ye, Jia Jia, Junliang XingACM MM 2023 · 5 citations
