Lune

ICML2025Top-tier venue

Inductive Moment Matching

Linqi Zhou, Stefano Ermon, Jiaming Song

2025Year
57Top-tier citations

Abstract

Diffusion models and Flow Matching generate high-quality samples but are slow at inference, and distilling them into few-step models often leads to instability and extensive tuning. To resolve these trade-offs, we propose Inductive Moment Matching (IMM), a new class of generative models for one-or few-step sampling with a single-stage training procedure. Unlike distillation, IMM does not require pre-training initialization and optimization of two networks; and unlike Consistency Models, IMM guarantees distribution-level convergence and remains stable under various hyperparameters and standard model architectures. IMM surpasses diffusion models on ImageNet-256×256 with 1.99 FID using only 8 inference steps and achieves state-ofthe-art 2-step FID of 1.98 on CIFAR-10 for a model trained from scratch.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext f67e21a3-23ae-4c33-979c-9fb501d93475

Cited by top-tier papers57

Ask how each one uses it

Builds on41

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines