Physics-Guided Motion Loss for Video Generation Model
Bowen Xue, Giuseppe Guarnera, Shuang Zhao, Zahra Montazeri
Abstract
Current video diffusion models generate visually compelling content but often struggle with physical motion, producing subtle artifacts like rubber-sheet deformations and inconsistent object motion. We introduce a frequency-domain physics prior that improves motion plausibility without modifying model architectures. Our method decomposes common motion patterns (translation, rotation, scaling) into lightweight spectral losses. Applied to Open-Sora, MVDIT, and Hunyuan, our approach improves both motion accuracy and action recognition by ∼11% on average on OpenVID-1M (relative), while maintaining visual quality. Additional results on Wan 2.1-14B show consistent gains on video-quality and physics-oriented metrics. User studies show 74-83% preference for our physics-enhanced videos. It also reduces warping error by 22-37% (depending on the backbone) and improves temporal consistency scores. These results indicate that simple, global spectral cues are an effective drop-in regularizer for physically plausible motion in video diffusion.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fff0a2d6-4cb6-4055-bb31-cd7a89b14b16Builds on11
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific TuningYuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang et al.ICLR 2024 · 1,493 citations
- Flexible Diffusion Modeling of Long VideosWilliam Harvey, Saeid Naderiparizi, Vaden Masrani, Christian Weilbach et al.NeurIPS 2022 · 384 citations
- Make-A-Video: Text-to-Video Generation without Text-Video DataUriel Singer, Adam Polyak, Thomas Hayes, Xi Yin et al.ICLR 2023 · 313 citations
- Scaling Autoregressive Video ModelsDirk Weissenborn, Oscar Täckström, Jakob UszkoreitICLR 2020 · 252 citations
Related papers
- MoAlign: Motion-Centric Representation Alignment for Video Diffusion ModelsAritra Bhowmik, Denis Korzhenkov, Cees G. M. Snoek, Amir Habibian et al.ICLR 2026 · 15 citations
- Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped NoiseRyan D. Burgert, Yuancheng Xu, Wenqi Xian, Oliver Pilarski et al.CVPR 2025
- PhysDiff-VTON: Cross-Domain Physics Modeling and Trajectory Optimization for Virtual Try-OnShibin Mei, Bingbing NiNeurIPS 2025 · 4 citations
- MotionRAG: Motion Retrieval-Augmented Image-to-Video GenerationChenhui Zhu, Yilu Wu, Shuai Wang, Gangshan Wu et al.NeurIPS 2025 · 8 citations
- SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction ScenariosLingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei Min et al.NeurIPS 2025 · 12 citations
