SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction
Zhengyuan Li, Kai Cheng, Anindita Ghosh, Uttaran Bhattacharya, Liangyan Gui, Aniket Bera
摘要
Text-based 3D human motion editing is a critical yet challenging task in computer vision and graphics. While training-free approaches have been explored, the recent release of the MotionFix dataset, which includes sourcetext-motion triplets, has opened new avenues for training, yielding promising results. However, existing methods struggle with precise control, often leading to misalignment between motion semantics and language instructions. In this paper, we introduce a related task -motion similarity prediction -and propose a multi-task training paradigm, where we train the model jointly on motion editing and motion similarity prediction to foster the learning of semantically meaningful representations. To complement this task, we design an advanced Diffusion-Transformerbased architecture that separately handles motion similarity prediction and motion editing. Extensive experiments demonstrate the state-of-the-art performance of our approach in both editing alignment and fidelity. Project URL: https://github.com/lzhyu/SimMotionEdit.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked ModelingAnindita Ghosh, Bing Zhou, Rishabh Dabral, Jian Wang 等SIGGRAPH 2025 · 被引用 11 次
- Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative LearningZhenwu Shi, Jingyu Gong, Peiwei Wang, Xingzan Wang 等CVPR 2026 · 被引用 4 次
- SceMoS: Scene-Aware 3D Human Motion Synthesis by Planning with Geometry-Grounded TokensAnindita Ghosh, Vladislav Golyanik, Taku Komura, Philipp Slusallek 等CVPR 2026 · 被引用 3 次
- Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion EditingGyojin Han, Junmo KimCVPR 2026 · 被引用 2 次
- U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationxiang deng, Feng Gao, Yong Zhang, Youxin Pang 等CVPR 2026 · 被引用 2 次
它引用的顶会 Paper28
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Representation Alignment for Diffusion Transformers without External ComponentsDengyang Jiang, Mengmeng Wang, Liuzhuozheng Li, Lei Zhang 等ICLR 2026 · 被引用 532 次
- Generating Diverse and Natural 3D Human Motions from TextChuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang 等CVPR 2022 · 被引用 462 次
相关 Paper
- MotionEdit: Benchmarking and Learning Motion-Centric Image EditingYixin Wan, Lei Ke, Wenhao Yu, Kai-Wei Chang 等CVPR 2026 · 被引用 7 次
- MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion ParadigmZiyan Guo, Zeyu Hu, De Wen Soh, Na ZhaoICCV 2025 · 被引用 10 次
- FLAME: Free-Form Language-Based Motion Synthesis & EditingJihoon Kim, Jiseob Kim, Sungjoon ChoiAAAI 2023 · 被引用 276 次
- Optimizing Diffusion Noise Can Serve As Universal Motion PriorsKorrawe Karunratanakul, Konpat Preechakul, Emre Aksan, Thabo Beeler 等CVPR 2024
- 3D-Fixup: Advancing Photo Editing with 3D PriorsYen-Chi Cheng, Krishna Kumar Singh, Jae Shin Yoon, Alexander G. Schwing 等SIGGRAPH 2025 · 被引用 4 次
