Inductive Moment Matching
Linqi Zhou, Stefano Ermon, Jiaming Song
摘要
Diffusion models and Flow Matching generate high-quality samples but are slow at inference, and distilling them into few-step models often leads to instability and extensive tuning. To resolve these trade-offs, we propose Inductive Moment Matching (IMM), a new class of generative models for one-or few-step sampling with a single-stage training procedure. Unlike distillation, IMM does not require pre-training initialization and optimization of two networks; and unlike Consistency Models, IMM guarantees distribution-level convergence and remains stable under various hyperparameters and standard model architectures. IMM surpasses diffusion models on ImageNet-256×256 with 1.99 FID using only 8 inference steps and achieves state-ofthe-art 2-step FID of 1.98 on CIFAR-10 for a model trained from scratch.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper57
- Mean Flows for One-step Generative ModelingZhengyang Geng, Mingyang Deng, Xingjian Bai, Zico Kolter 等NeurIPS 2025 · 被引用 628 次
- Improved Mean Flows: On the Challenges of Fastforward Generative ModelsZhengyang Geng, Yiyang Lu, Zongze Wu, Eli Shechtman 等CVPR 2026 · 被引用 116 次
- How to build a consistency model: Learning flow maps via self-distillationNicholas M. Boffi, Michael S. Albergo, Eric Vanden-EijndenNeurIPS 2025 · 被引用 111 次
- Align Your Flow: Scaling Continuous-Time Flow Map DistillationAmirmojtaba Sabour, Sanja Fidler, Karsten KreisNeurIPS 2025 · 被引用 91 次
- AlphaFlow: Understanding and Improving MeanFlow ModelsHuijie Zhang, Aliaksandr Siarohin, Willi Menapace, Michael Vasilkovsky 等ICLR 2026 · 被引用 44 次
它引用的顶会 Paper41
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
相关 Paper
- One-Step Diffusion with Distribution Matching DistillationTianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman 等CVPR 2024 · 被引用 75 次
- Multistep Distillation of Diffusion Models via Moment MatchingTim Salimans, Thomas Mensink, Jonathan Heek, Emiel HoogeboomNeurIPS 2024 · 被引用 93 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- Progressive Distillation for Fast Sampling of Diffusion ModelsTim Salimans, Jonathan HoICLR 2022 · 被引用 9 次
- Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Image GenerationQuan Dao, Hao Phung, Trung Tuan Dao, Dimitris N. Metaxas 等AAAI 2025 · 被引用 11 次
