Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates
Connor Mooney, Zhongjian Wang, Jack Xin, Yifeng Yu
Abstract
We establish global well-posedness and convergence of the score-based generative models (SGM) under minimal general assumptions of initial data for score estimation. For the smooth case, we start from a Lipschitz bound of the score function with optimal time length. The optimality is validated by an example whose Lipschitz constant of scores is bounded at initial but blows up in finite time. This necessitates the separation of time scales in conventional bounds for non-log-concave distributions. In contrast, our follow up analysis only relies on a local Lipschitz condition and is valid globally in time. This leads to the convergence of numerical scheme without time separation. For the non-smooth case, we show that the optimal Lipschitz bound is O(1/t) in the point-wise sense for distributions supported on a compact, smooth and low-dimensional manifold with boundary.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Masked Diffusion Transformer is a Strong Image SynthesizerShanghua Gao, Pan Zhou, Ming-Ming Cheng, Shuicheng YanICCV 2023 · 290 citations
- Convergence for score-based generative modeling with polynomial complexityHolden Lee, Jianfeng Lu, Yixin TanNeurIPS 2022 · 221 citations
- Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness AssumptionsHongrui Chen, Holden Lee, Jianfeng LuICML 2023 · 212 citations
Related papers
- Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distanceMarta Gentiloni Silveri, Antonio OcelloICML 2025
- Score-Based Generative Models Detect ManifoldsJakiw PidstrigachNeurIPS 2022 · 146 citations
- The Accumulation of Score Estimation Error in Diffusion ModelsBaoxiang He, Valentio Iverson, Shuai Li, Cheng Chen et al.ICML 2026
- Approximation and Generalization Abilities of Score-based Neural Network Generative Models for Sub-Gaussian DistributionsGuoji Fu, Wee Sun LeeNeurIPS 2025 · 1 citation
- Sampling is as easy as keeping the consistency: convergence guarantee for Consistency ModelsJunlong Lyu, Zhitang Chen, Shoubo FengICML 2024 · 7 citations
