Scaling Large Motion Models with Million-Level Human Motions
Ye Wang, Sipeng Zheng, Bin Cao, Qianshan Wei, Weishuai Zeng, Qin Jin, Zongqing Lu
Abstract
Inspired by the recent success of LLMs, the field of human motion understanding has increasingly shifted toward developing large motion models. Despite some progress, current efforts remain far from achieving truly generalist models, primarily due to the lack of massive high-quality data. To address this gap, we present MotionLib, the first million-level dataset for motion generation, which is at least 15× larger than existing counterparts and enriched with hierarchical text descriptions. Using MotionLib, we train a large motion model named Being-M0, demonstrating robust performance across a wide range of human activities, including unseen ones. Through systematic investigation, for the first time, we highlight the importance of scaling both data and model size for advancing motion generation, along with key insights to achieve this goal. To better integrate the motion modality, we propose Motionbook, an innovative motion encoding approach including (1) a compact yet lossless feature to represent motions; (2) a novel 2D lookup-free motion tokenizer that preserves fine-grained motion details while expanding codebook capacity, significantly enhancing the representational power of motion tokens. We believe this work lays the groundwork for developing more versatile and powerful motion generation models in the future. For further details, visit https://beingbeyond. github.io/Being-M0/ .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ae6a2a4-3a40-4be4-ab63-60ea54351704Cited by top-tier papers8
- Vision-Language-Action Pretraining from Large-Scale Human VideosHao Luo, Yicheng Feng, Wanpeng Zhang, Sipeng Zheng et al.ICML 2026 · 104 citations
- CLUTCH: Contextualized Language model for Unlocking Text-Conditioned Hand motion modelling in the wildBalamurugan Thambiraja, Omid Taheri, Radek Danecek, Giorgio Becherini et al.ICLR 2026 · 2 citations
- RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion GenerationJiahao Zhang, Joseph Liu, Young-Yoon Lee, Seonghyeon Moon et al.CVPR 2026 · 2 citations
- Iterative Closed-Loop Motion Synthesis for Scaling the Capabilities of Humanoid ControlWeisheng Xu, Qiwei Wu, Jiaxi Zhang, Jing Tan et al.CVPR 2026 · 1 citation
- FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase ManifoldsMarco Pegoraro, Evan Atherton, Bruno Roy, Aliasghar Khani et al.ICML 2026 · 1 citation
Builds on24
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
Related papers
- Go to Zero: Towards Zero-Shot Motion Generation with Million-Scale DataKe Fan, Shunlin Lu, Minyue Dai, Runyi Yu et al.ICCV 2025 · 11 citations
- MotionMaster: Generalizable Text-Driven Motion Generation and EditingNan Jiang, Yunhao Li, Lexi Pang, Zimo He et al.CVPR 2026
- MotionCtrl: A Real-Time Controllable Vision-Language-Motion ModelBin Cao, Sipeng Zheng, Ye Wang, Lujie Xia et al.ICCV 2025 · 1 citation
- SnapMoGen: Human Motion Generation from Expressive TextsChuan Guo, Inwoo Hwang, Jian Wang, Bing ZhouNeurIPS 2025 · 50 citations
- OpenT2M: No-frill Motion Generation with Open-source, Large-scale, High-quality DataBin Cao, Sipeng Zheng, Hao Luo, Boyuan Li et al.CVPR 2026 · 1 citation
