MagCache: Fast Video Generation with Magnitude-Aware Cache
Zehong Ma, Longhui Wei, Feng Wang, Shiliang Zhang, Qi Tian
Abstract
Existing acceleration techniques for video diffusion models often rely on uniform heuristics or time-embedding variants to skip timesteps and reuse cached features. These approaches typically require extensive calibration with curated prompts and risk inconsistent outputs due to prompt-specific overfitting. In this paper, we introduce a novel and robust discovery: a unified magnitude law observed across different models and prompts. Specifically, the magnitude ratio of successive residual outputs decreases monotonically, steadily in most timesteps while rapidly in the last several steps. Leveraging this insight, we introduce a Magnitude-aware Cache (MagCache) that adaptively skips unimportant timesteps using an error modeling mechanism and adaptive caching strategy. Unlike existing methods requiring dozens of curated samples for calibration, MagCache only requires a single sample for calibration. Experimental results show that MagCache achieves 2.10×-2.68× speedups on Open-Sora, CogVideoX, Wan 2.1, and HunyuanVideo, while preserving superior visual fidelity. It significantly outperforms existing methods in LPIPS, SSIM, and PSNR, under similar computational budgets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dbfb2b8a-f598-4dd3-9ecf-146ed99b1469Cited by top-tier papers7
- DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image GenerationZehong Ma, Longhui Wei, Shuai Wang, Shiliang Zhang et al.CVPR 2026 · 59 citations
- TC-Pade: Trajectory-Consistent Pade Approximation for Diffusion AccelerationShaoxuan He, Benlei Cui, Bukun Huang, Zhizeng Ye et al.CVPR 2026 · 9 citations
- SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion ModelsJiwoo Chung, Sangeek Hyun, MinKyu Lee, Byeongju Han et al.CVPR 2026 · 9 citations
- DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature CachingChang Zou, Changlin Li, Songtao Liu, Zhao Zhong et al.CVPR 2026 · 5 citations
- SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware CachingYasaman Haghighi, Alexandre AlahiCVPR 2026 · 5 citations
Builds on44
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- D2Cache: Second-Order Delta Caching for Higher Video Diffusion AccelerationEnhuai Liu, Yunke Wang, Changming Sun, Chang XuCVPR 2026
- Adaptive Caching for Faster Video Generation With Diffusion TransformersKumara Kahatapitiya, Haozhe Liu, Sen He, Ding Liu et al.ICCV 2025 · 5 citations
- DiCache: Let Diffusion Model Determine Its Own CacheJiazi Bu, Pengyang Ling, Yujie Zhou, Yibin Wang et al.ICLR 2026 · 36 citations
- ERTACache: Error Rectification and Timesteps Adjustment for Efficient DiffusionXurui Peng, Chenqian Yan, Hong Liu, Rui Ma et al.ICLR 2026 · 10 citations
- Denoising as Path Planning: Training-Free Acceleration of Diffusion Models with DPCacheBowen Cui, Yuanbin Wang, Huajiang Xu, Biaolong Chen et al.CVPR 2026 · 6 citations
