FlowCast: Trajectory Forecasting for Scalable Zero-Cost Speculative Flow Matching
Divya Jyoti Bajpai, Shubham Agarwal, Apoorv Saxena, Kuldeep Kulkarni, Subrata Mitra, Manjesh K. Hanawal
摘要
Flow Matching (FM) has recently emerged as a powerful approach for high-quality visual generation. However, their prohibitively slow inference due to a large number of denoising steps limits their potential use in real-time or interactive applications. Existing acceleration methods, like distillation, truncation, or consistency training, either degrade quality, incur costly retraining, or lack generalization. We propose FlowCast, a training-free speculative generation framework that accelerates inference by exploiting the fact that FM models are trained to preserve constant velocity. FlowCast speculates future velocity by extrapolating current velocity without incurring additional time cost, and accepts it if it is within a mean-squared error threshold. This constant-velocity forecasting allows redundant steps in stable regions to be aggressively skipped while retaining precision in complex ones. FlowCast is a plug-and-play framework that integrates seamlessly with any FM model and requires no auxiliary networks. We also present a theoretical analysis and bound the worst-case deviation between speculative and full FM trajectories. Empirical evaluations demonstrate that FlowCast achieves speedup in image generation, video generation, and editing tasks, outperforming existing baselines with no quality loss as compared to standard full generation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen 等NeurIPS 2022 · 被引用 2,653 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image GenerationXingchao Liu, Xiwen Zhang, Jianzhu Ma, Jian Peng 等ICLR 2024 · 被引用 358 次
- PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play AcceleratorHanshu Yan, Xingchao Liu, Jiachun Pan, Jun Hao Liew 等NeurIPS 2024 · 被引用 108 次
相关 Paper
- FastFlow: Accelerating The Generative Flow Matching Models with Bandit InferenceDivya Jyoti Bajpai, Dhruv Bhardwaj, Soumya Roy, Tejas Duseja 等ICLR 2026 · 被引用 3 次
- MeanCache: From Instantaneous to Average Velocity for Accelerating Flow Matching InferenceHuanlin Gao, Ping Chen, Fuyuan Shi, Ruijia Wu 等ICLR 2026 · 被引用 7 次
- FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity RefinerWenliang Zhao, Minglei Shi, Xumin Yu, Jie Zhou 等NeurIPS 2024 · 被引用 6 次
- DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature CachingChang Zou, Changlin Li, Songtao Liu, Zhao Zhong 等CVPR 2026 · 被引用 5 次
- Accelerating Diffusion Sampling via Exploiting Local Transition CoherenceShangwen Zhu, Han Zhang, Zhantao Yang, Qianyu Peng 等ICCV 2025
