Motion Control via Metric-Aligning Motion Matching
Naoki Agata, Takeo Igarashi
Abstract
Control sequence Original motion Aligned motionFig. 1.Overview of our method.Our method aligns given original motion to given control sequence.Our method can take arbitrary control sequences, such as sketches, labels, audio, and motions.Our method solely relies on within-domain distance in original and control, without needing manual definition of mapping or training with annotated data.We introduce a novel method for controlling a motion sequence using an arbitrary temporal control sequence using temporal alignment.Temporal alignment of motion has gained significant attention owing to its applications in motion control and retargeting.Traditional methods rely on either learned or hand-craft cross-domain mappings between frames in the original and control domains, which often require large, paired, or annotated datasets and time-consuming training.Our approach, named Metric-Aligning Motion Matching, achieves alignment by solely considering within-domain distances.It computes distances among patches in each domain and seeks a matching that optimally aligns the two within-domain distances.This framework allows for the alignment of a motion sequence to various types of control sequences, including sketches, labels, audio, and another motion sequence, all without the need for manually defined mappings or training with annotated data.We demonstrate the effectiveness of our approach through applications in efficient motion control, showcasing its potential in practical scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on14
- AI Choreographer: Music Conditioned 3D Dance Generation with AIST++Ruilong Li, Shan Yang, David A. Ross, Angjoo KanazawaICCV 2021 · 701 citations
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung et al.SIGGRAPH 2020 · 210 citations
- Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion ModelsSimon Alexanderson, Rajmund Nagy, Jonas Beskow, Gustav Eje HenterSIGGRAPH 2023 · 191 citations
- Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic MemoryLi Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin et al.CVPR 2022 · 170 citations
- SinDDM: A Single Image Denoising Diffusion ModelVladimir Kulikov, Shahar Yadin, Matan Kleiner, Tomer MichaeliICML 2023 · 113 citations
Related papers
- VidSTR: Automatic Spatiotemporal Retargeting of Speech-Driven Video CompositionsJoshua Kong Yang, Mackenzie Leake, Jeff Huang, Stephen DiVerdiCHI 2025
- MotionShot: Adaptive Motion Transfer Across Arbitrary Objects for Text-to-Video GenerationYanchen Liu, Yanan Sun, Zhening Xing, Junyao Gao et al.ICCV 2025 · 5 citations
- Exploring Timeline Control for Facial Motion GenerationYifeng Ma, Jinwei Qi, Chaonan Ji, Peng Zhang et al.CVPR 2025
- Weakly-Supervised Temporal Action Alignment Driven by Unbalanced Spectral Fused Gromov-Wasserstein DistanceDixin Luo, Yutong Wang, Angxiao Yue, Hongteng XuACM MM 2022 · 8 citations
- STaR: Seamless Spatial-Temporal Aware Motion Retargeting with Penetration and Consistency ConstraintsXiaohang Yang, Qing Wang, Jiahao Yang, Gregory G. Slabaugh et al.ICCV 2025 · 2 citations
