The Accumulation of Score Estimation Error in Diffusion Models
Baoxiang He, Valentio Iverson, Shuai Li, Cheng Chen, Bo Jiang
Abstract
Diffusion models are widely used for high-quality generation, but their performance is sensitive to the accuracy of the estimated score. We first derive a stepwise Wasserstein error bound in a Gaussian-mixture setting, where the score admits a closed-form structure, and the score Hessian can be controlled explicitly, leading to sharp Wasserstein estimates. We then extend the analysis to general data distributions, which yields a more general but typically looser upper bound. This general bound can be sharpened under mild regularity: when the initial distribution has a globally Lipschitz score, the curvature contribution at small times is uniformly bounded, avoiding the worst-case blow-up. The results hold for both variance-preserving (VP) and variance-exploding (VE) diffusions, and apply to both the reverse-time SDE and the associated probability-flow ODE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0aee6b11-eb0f-4aa0-8f95-cfdfccdf1c17Builds on14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
Related papers
- Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errorsÉmile Pierret, Bruno GalerneICML 2025
- Towards Non-Asymptotic Convergence for Diffusion-Based Generative ModelsGen Li, Yuting Wei, Yuxin Chen, Yuejie ChiICLR 2024 · 39 citations
- Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential EquationsYu Cao, Jingrun Chen, Yixin Luo, Xiang ZhouNeurIPS 2023 · 20 citations
- Score-Based Diffusion Modeling for Nonparametric Empirical Bayes in Heteroscedastic Gaussian MixturesGongyu Chen, Ying CuiNeurIPS 2025 · 1 citation
- Diffusion Models are Minimax Optimal Distribution EstimatorsKazusato Oko, Shunta Akiyama, Taiji SuzukiICML 2023 · 152 citations
