pi-Flow: Policy-Based Few-Step Generation via Imitation Distillation
Hansheng Chen, Kai Zhang, Hao Tan, Leonidas Guibas, Gordon Wetzstein, Sai Bi
摘要
Few-step diffusion or flow-based generative models typically distill a velocity-predicting teacher into a student that predicts a shortcut towards denoised data. This format mismatch has led to complex distillation procedures that often suffer from a quality--diversity trade-off. To address this, we propose policy-based flow models (-Flow). -Flow modifies the output layer of a student flow model to predict a network-free policy at one timestep. The policy then produces dynamic flow velocities at future substeps with negligible overhead, enabling fast and accurate ODE integration without extra network evaluations. To match the policy's ODE trajectory to the teacher's, we introduce a novel imitation distillation approach, which matches the policy's velocity to the teacher's along the policy's trajectory using a standard flow matching loss. By simply mimicking the teacher's behavior, -Flow enables stable and scalable training and avoids the quality--diversity trade-off. On ImageNet , it attains a 1-NFE FID of 2.85, outperforming previous 1-NFE models of the same DiT architecture. On FLUX.1-12B and Qwen-Image-20B at 4 NFEs, -Flow achieves substantially better diversity than state-of-the-art DMD models, while maintaining teacher-level quality.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Improved Mean Flows: On the Challenges of Fastforward Generative ModelsZhengyang Geng, Yiyang Lu, Zongze Wu, Eli Shechtman 等CVPR 2026 · 被引用 116 次
- Transition Matching Distillation for Fast Video GenerationWeili Nie, Julius Berner, Nanye Ma, Chao Liu 等CVPR 2026 · 被引用 24 次
- TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial FlowsZhenglin Cheng, Peng Sun, Jianguo Li, Tao LinICLR 2026 · 被引用 17 次
- Flow Map Distillation Without DataShangyuan Tong, Nanye Ma, Saining Xie, Tommi S. JaakkolaCVPR 2026 · 被引用 13 次
- Bidirectional Normalizing Flow: From Data to Noise and BackYiyang Lu, Qiao Sun, Xianbang Wang, Zhicheng Jiang 等CVPR 2026 · 被引用 7 次
它引用的顶会 Paper37
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
相关 Paper
- One-Step Diffusion with Distribution Matching DistillationTianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman 等CVPR 2024 · 被引用 75 次
- Inductive Moment MatchingLinqi Zhou, Stefano Ermon, Jiaming SongICML 2025
- Mean Flows for One-step Generative ModelingZhengyang Geng, Mingyang Deng, Xingjian Bai, Zico Kolter 等NeurIPS 2025 · 被引用 628 次
- Multistep Distillation of Diffusion Models via Moment MatchingTim Salimans, Thomas Mensink, Jonathan Heek, Emiel HoogeboomNeurIPS 2024 · 被引用 93 次
- Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free LunchXu Cai, Yang Wu, Qianli Chen, Haoran Wu 等NeurIPS 2025 · 被引用 4 次
