Improved Mean Flows: On the Challenges of Fastforward Generative Models
Zhengyang Geng, Yiyang Lu, Zongze Wu, Eli Shechtman, J. Zico Kolter, Kaiming He
摘要
MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward''nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's training target depends not only on the underlying ground-truth fields but also on the network itself. To address this issue, we recast the objective as a loss on the instantaneous velocity , re-parameterized by a network that predicts the average velocity . Our reformulation yields a more standard regression problem and improves the training stability. Second, the original MF fixes the classifier-free guidance scale during training, which sacrifices flexibility. We tackle this issue by formulating guidance as explicit conditioning variables, thereby retaining flexibility at test time. The diverse conditions are processed through in-context conditioning, which reduces model size and benefits performance. Overall, our () method, trained entirely from scratch, achieves FID with a single function evaluation (1-NFE) on ImageNet 256256. iMF substantially outperforms prior methods of this kind and closes the gap with multi-step methods while using no distillation. We hope our work will further advance fastforward generative modeling as a stand-alone paradigm.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper15
- Categorical Flow MapsDaan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein 等ICML 2026 · 被引用 23 次
- Bidirectional Normalizing Flow: From Data to Noise and BackYiyang Lu, Qiao Sun, Xianbang Wang, Zhicheng Jiang 等CVPR 2026 · 被引用 7 次
- Bi-Anchor Interpolation Solver for Accelerating Generative ModelingHongxu CHEN, Hongxiang Li, Zhen Wang, Long ChenICML 2026 · 被引用 3 次
- WFR-MFM: One-Step Inference for Dynamic Unbalanced Optimal TransportXinyu Wang, Ruoyu Wang, Qiangwei Peng, Peijie Zhou 等ICML 2026 · 被引用 3 次
- Learning Hamiltonian Flow Maps: Mean Flow Consistency for Large-Timestep Molecular DynamicsWinfried Ripken, Michael Plainer, Gregor Lied, Thorben Frank 等ICML 2026 · 被引用 3 次
它引用的顶会 Paper40
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
相关 Paper
- Mean Flows for One-step Generative ModelingZhengyang Geng, Mingyang Deng, Xingjian Bai, Zico Kolter 等NeurIPS 2025 · 被引用 628 次
- Understanding, Accelerating, and Improving MeanFlow TrainingJin-Young Kim, Hyojun Go, Lea Bogensperger, Julius Erbach 等CVPR 2026 · 被引用 4 次
- SoFlow: Solution Flow Models for One-Step Generative ModelingTianze Luo, Haotian Yuan, Zhuang LiuICLR 2026 · 被引用 18 次
- One-step Latent-free Image Generation with Pixel Mean FlowsYiyang Lu, Susie Lu, Qiao Sun, Hanhong Zhao 等ICML 2026
- MeanFlow Transformers with Representation AutoencodersZheyuan Hu, Chieh-Hsin Lai, Ge Wu, Yuki Mitsufuji 等CVPR 2026 · 被引用 6 次
