Open the Motion Door: Atomic Motion Decomposition and Recomposition for Open-Vocabulary Motion Generation
Ke Fan, Jiangning Zhang, Ran Yi, Jingyu Gong, Yabiao Wang, yating wang, Xin Tan, Chengjie Wang, Lizhuang Ma
Abstract
Text-to-motion generation is a fundamental task in computer vision, aiming to synthesize 3D human motion sequences from natural language descriptions. However, due to the limited scale and diversity of existing datasets, models trained to directly map raw text to motion often struggle to generalize to out-of-domain textual inputs. We observe that although high-level motion semantics vary widely, many motions share a common set of underlying atomic motions-that is, simple, reusable body-part movements. Building on this insight, we introduce an Atomic Motion Decomposition and Recomposition framework for open-vocabulary text-to-motion generation. Our approach consists of two key components: a Textual Decomposition module that parses out-of-domain descriptions into atomic motion units, and an Atomic Recomposition module that integrates these units to produce the final motion sequence. Our model achieves a competitive performance on the in-domain HumanML3D dataset, and extensive experiments on two out-of-domain datasets (IDEA400 and Mixamo) demonstrate that our method substantially outperforms state-of-the-art approaches in open-vocabulary motion generation. The project page is https : / / vankouf.github.io/OpenTheMotionDoor/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on44
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll et al.ICCV 2019 · 1,784 citations
- MotionGPT: Human Motion as a Foreign LanguageBiao Jiang, Xin Chen, Wen Liu, Jingyi Yu et al.NeurIPS 2023 · 698 citations
- Action-Conditioned 3D Human Motion Synthesis with Transformer VAEMathis Petrovich, Michael J. Black, Gül VarolICCV 2021 · 672 citations
- Generating Diverse and Natural 3D Human Motions from TextChuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang et al.CVPR 2022 · 462 citations
- Action2Motion: Conditioned Generation of 3D Human MotionsChuan Guo, Xinxin Zuo, Sen Wang, Shihao Zou et al.ACM MM 2020 · 394 citations
Related papers
- Breaking The Limits of Text-conditioned 3D Motion Synthesis with Elaborative DescriptionsYijun Qian, Jack Urbanek, Alexander G. Hauptmann, Jungdam WonICCV 2023 · 15 citations
- Language-guided Human Motion Synthesis with Atomic ActionsYuanhao Zhai, Mingzhen Huang, Tianyu Luan, Lu Dong et al.ACM MM 2023 · 12 citations
- A Motion is Worth a Hybrid Sentence: Taming Language Model for Unified Motion Generation by Fine-grained PlanningRonghui Li, Lingxiao Han, Shi Shu, Yueyao Liu et al.ACM MM 2025
- FrankenMotion: Part-level Human Motion Generation and CompositionChuqiao Li, Xianghui Xie, Yong Cao, Andreas Geiger et al.CVPR 2026 · 10 citations
- Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time TrainingYunjiao Zhou, Xinyan Chen, Junlang Qian, Lihua Xie et al.AAAI 2026 · 2 citations
