O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
Gen Li, Yuling Yan
摘要
Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their superior empirical performance, existing theoretical guarantees are often constrained by stringent assumptions or suboptimal convergence rates. In this paper, we establish a fast convergence theory for the denoising diffusion probabilistic model (DDPM), a widely used SDE-based sampler, under minimal assumptions. Our analysis shows that, provided -accurate estimates of the score functions, the total variation distance between the target and generated distributions is upper bounded by (ignoring logarithmic factors), where is the data dimensionality and is the number of steps. This result holds for any target distribution with finite first-order moment. Moreover, we show that with careful coefficient design, the convergence rate improves to , where is the intrinsic dimension of the target data distribution. This highlights the ability of DDPM to automatically adapt to unknown low-dimensional structures, a common feature of natural image distributions. These results are achieved through a novel set of analytical tools that provides a fine-grained characterization of how the error propagates at each step of the reverse process.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper14
- Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion ModelsGen Li, Yuling YanNeurIPS 2024 · 被引用 66 次
- Neural Network-Based Score Estimation in Diffusion Models: Optimization and GeneralizationYinbin Han, Meisam Razaviyayn, Renyuan XuICLR 2024 · 被引用 33 次
- Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language ModelsGen Li, Changxiao CaiNeurIPS 2025 · 被引用 22 次
- Dimension-free convergence of diffusion models for approximate Gaussian mixturesGen Li, Changxiao Cai, Yuting WeiICML 2026 · 被引用 20 次
- The Serial Scaling HypothesisYuxi Liu, Konpat Preechakul, Kananart Kuwaranancharoen, Yutong BaiICLR 2026 · 被引用 12 次
它引用的顶会 Paper22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
相关 Paper
- Towards Non-Asymptotic Convergence for Diffusion-Based Generative ModelsGen Li, Yuting Wei, Yuxin Chen, Yuejie ChiICLR 2024 · 被引用 39 次
- The probability flow ODE is provably fastSitan Chen, Sinho Chewi, Holden Lee, Yuanzhi Li 等NeurIPS 2023 · 被引用 179 次
- Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionsSitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li 等ICLR 2023 · 被引用 15 次
- Assessing the quality of denoising diffusion models in Wasserstein distance: noisy score and optimal boundsVahan Arsenyan, Elen Vardanyan, Arnak S. DalalyanNeurIPS 2025 · 被引用 6 次
- Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic LocalizationJoe Benton, Valentin De Bortoli, Arnaud Doucet, George DeligiannidisICLR 2024 · 被引用 203 次
