RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers
Ahmet Berke Gökmen, Yigit Ekin, Bahri Batuhan Bilecen, Aysegul Dundar
Abstract
We propose RoPECraft, a training-free video motion transfer method for diffusion transformers that operates solely by modifying their rotary positional embeddings (RoPE). We first extract dense optical flow from a reference video, and utilize the resulting motion offsets to warp the complex-exponential tensors of RoPE, effectively encoding motion into the generation process. These embeddings are then further optimized during denoising time steps via trajectory alignment between the predicted and target velocities using a flow-matching objective. To keep the output faithful to the text prompt and prevent duplicate generations, we incorporate a regularization term based on the phase components of the reference video's Fourier transform, projecting the phase angles onto a smooth manifold to suppress high-frequency artifacts. Experiments on benchmarks reveal that RoPECraft outperforms all recently published methods, both qualitatively and quantitatively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- LAMP: Language-Assisted Motion Planning for Controllable Video GenerationMuhammed Burak Kizil, Enes Şanlı, Niloy J. Mitra, Erkut Erdem et al.CVPR 2026 · 4 citations
- SafeRoPE: Risk-specific Head-wise Embedding Rotation for Safe Generation in Rectified Flow TransformersXiang Yang, Feifei Li, Mi Zhang, Geng Hong et al.CVPR 2026 · 2 citations
- Motion4Motion: Motion Transfer Across Subjects at InferenceLing-Hao Chen, Zixin Yin, Duomin Wang, Xianfang Zeng et al.SIGGRAPH 2026
- Video Analysis and Generation via a Semantic Progress FunctionGal Metzer, Sagi Polaczek, Ali Mahdavi-Amiri, Raja Giryes et al.SIGGRAPH 2026
- LieWarper: Geometry-Aware Motion Transfer via Lie AlgebraLinsong Shan, Laurence Yang, Zecan Yang, Fukai Guo et al.ICML 2026
Builds on29
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- Dlfr-Gen: Diffusion-Based Video Generation With Dynamic Latent Frame RateZhihang Yuan, Rui Xie, Yuzhang Shang, Hanling Zhang et al.ICCV 2025 · 1 citation
- Video Motion Transfer with Diffusion TransformersAlexander Pondaven, Aliaksandr Siarohin, Sergey Tulyakov, Philip Torr et al.CVPR 2025
- ReRoPE: Repurposing RoPE for Relative Camera ControlChunyang Li, Yuanbo Yang, Jiahao Shao, Hongyu Zhou et al.SIGGRAPH 2026 · 2 citations
- FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image EditingTianyi Wei, Yifan Zhou, Dongdong Chen, Xingang PanICCV 2025
- MotionFlow: Attention-Driven Motion Transfer in Video Diffusion ModelsTuna Han Salih Meral, Hidir Yesiltepe, Connor Dunlop, Pinar YanardagAAAI 2026
