The Accumulation of Score Estimation Error in Diffusion Models
Baoxiang He, Valentio Iverson, Shuai Li, Cheng Chen, Bo Jiang
摘要
Diffusion models are widely used for high-quality generation, but their performance is sensitive to the accuracy of the estimated score. We first derive a stepwise Wasserstein error bound in a Gaussian-mixture setting, where the score admits a closed-form structure, and the score Hessian can be controlled explicitly, leading to sharp Wasserstein estimates. We then extend the analysis to general data distributions, which yields a more general but typically looser upper bound. This general bound can be sharpened under mild regularity: when the initial distribution has a globally Lipschitz score, the curvature contribution at small times is uniformly bounded, avoiding the worst-case blow-up. The results hold for both variance-preserving (VP) and variance-exploding (VE) diffusions, and apply to both the reverse-time SDE and the associated probability-flow ODE.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 被引用 5,234 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
相关 Paper
- Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errorsÉmile Pierret, Bruno GalerneICML 2025
- Towards Non-Asymptotic Convergence for Diffusion-Based Generative ModelsGen Li, Yuting Wei, Yuxin Chen, Yuejie ChiICLR 2024 · 被引用 39 次
- Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential EquationsYu Cao, Jingrun Chen, Yixin Luo, Xiang ZhouNeurIPS 2023 · 被引用 20 次
- Score-Based Diffusion Modeling for Nonparametric Empirical Bayes in Heteroscedastic Gaussian MixturesGongyu Chen, Ying CuiNeurIPS 2025 · 被引用 1 次
- Diffusion Models are Minimax Optimal Distribution EstimatorsKazusato Oko, Shunta Akiyama, Taiji SuzukiICML 2023 · 被引用 152 次
