Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance
Marta Gentiloni Silveri, Antonio Ocello
Abstract
Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W 2 -distance rely on stringent assumptions about the data distribution. In this work, we present a novel framework for analyzing W 2convergence in SGMs, significantly relaxing traditional assumptions such as log-concavity and score regularity. Leveraging the regularization properties of the Ornstein-Uhlenbeck (OU) process, we show that weak log-concavity of the data distribution evolves into log-concavity over time. This transition is rigorously quantified through a PDE-based analysis of the Hamilton-Jacobi-Bellman equation governing the log-density of the forward process. Moreover, we establish that the drift of the time-reversed OU process alternates between contractive and non-contractive regimes, reflecting the dynamics of concavity. Our approach circumvents the need for stringent regularity conditions on the score function and its estimators, relying instead on milder, more practical assumptions. We demonstrate the wide applicability of this framework through explicit computations on Gaussian mixture models, illustrating its versatility and potential for broader classes of data distributions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bd487fb8-93b8-4a85-bbb1-ab54d843d2cdCited by top-tier papers7
- Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order AccelerationYifeng Yu, Lu YuNeurIPS 2025 · 19 citations
- Assessing the quality of denoising diffusion models in Wasserstein distance: noisy score and optimal boundsVahan Arsenyan, Elen Vardanyan, Arnak S. DalalyanNeurIPS 2025 · 6 citations
- Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusionAdrien Vacher, Omar Chehab, Anna KorbaNeurIPS 2025 · 5 citations
- Wasserstein Convergence of Critically Damped Langevin DiffusionsStanislas Strasman, Sobihan Surendran, Claire Boyer, Sylvain Le Corff et al.NeurIPS 2025 · 5 citations
- Exponential Convergence Guarantees for Iterative Markovian FittingMarta Gentiloni Silveri, Giovanni Conforti, Alain DurmusNeurIPS 2025 · 4 citations
Builds on14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative ModelingValentin De Bortoli, James Thornton, Jeremy Heng, Arnaud DoucetNeurIPS 2021 · 811 citations
- Convergence for score-based generative modeling with polynomial complexityHolden Lee, Jianfeng Lu, Yixin TanNeurIPS 2022 · 221 citations
Related papers
- Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz EstimatesConnor Mooney, Zhongjian Wang, Jack Xin, Yifeng YuICLR 2025
- FP-Diffusion: Improving Score-based Diffusion Models by Enforcing the Underlying Score Fokker-Planck EquationChieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka et al.ICML 2023 · 42 citations
- Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness AssumptionsHongrui Chen, Holden Lee, Jianfeng LuICML 2023 · 212 citations
- Score-based generative models are provably robust: an uncertainty quantification perspectiveNikiforos Mimikos-Stamatopoulos, Benjamin J. Zhang, Markos A. KatsoulakisNeurIPS 2024 · 15 citations
- Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errorsÉmile Pierret, Bruno GalerneICML 2025
