Lune

NeurIPS2024Top-tier venue

Theoretical guarantees in KL for Diffusion Flow Matching

Marta Gentiloni Silveri, Alain Durmus, Giovanni Conforti

2024Year
16Citations
4Top-tier citations

Abstract

Flow Matching (FM) (also referred to as stochastic interpolants or rectified flows) stands out as a class of generative models that aims to bridge in finite time the target distribution ν⋆\nu^\star with an auxiliary distribution μ\mu, leveraging a fixed coupling π\pi and a bridge which can either be deterministic or stochastic. These two ingredients define a path measure which can then be approximated by learning the drift of its Markovian projection. The main contribution of this paper is to provide relatively mild assumptions on ν⋆\nu^\star, μ\mu and π\pi to obtain non-asymptotics guarantees for Diffusion Flow Matching (DFM) models using as bridge the conditional distribution associated with the Brownian motion. More precisely, we establish bounds on the Kullback-Leibler divergence between the target distribution and the one generated by such DFM models under moment conditions on the score of ν⋆\nu^\star, μ\mu and π\pi, and a standard L2L^2-drift-approximation error assumption.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 5034aa9f-e936-4aea-a5ce-3a70c07f21c0

Cited by top-tier papers4

Ask how each one uses it

Builds on16

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines