Dimension-free convergence of diffusion models for approximate Gaussian mixtures
Gen Li, Changxiao Cai, Yuting Wei
Abstract
Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for accurate sample generation should scale linearly with data dimension, this does not reflect the practical efficiency of widely used algorithms like Denoising Diffusion Probabilistic Models (DDPMs). This paper investigates the effectiveness of diffusion models in sampling complex high-dimensional distributions that can be well-approximated by Gaussian Mixture Models (GMMs). For these distributions, our main result shows that DDPM takes at most iterations to attain an -accurate distribution in total variation (TV) distance, independent of both the ambient dimension and the number of components , up to logarithmic factors. Furthermore, this result remains robust to score estimation errors. These findings highlight the remarkable effectiveness of diffusion models in high-dimensional settings given the universal approximation capability of GMMs, and provide theoretical insights into their practical success.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language ModelsGen Li, Changxiao CaiNeurIPS 2025 · 22 citations
- Stage-wise Dynamics of Classifier-Free Guidance in Diffusion ModelsCheng Jin, Qitan Shi, Yuantao GuICLR 2026 · 13 citations
- High-accuracy sampling for diffusion models and log-concave distributionsFan Chen, Sinho Chewi, Constantinos Daskalakis, Alexander RakhlinICML 2026 · 12 citations
- High-accuracy and dimension-free sampling with diffusionsKhashayar Gatmiry, Sitan Chen, Adil SalimICML 2026 · 7 citations
- Can Diffusion Models Disentangle? A Theoretical PerspectiveLiming Wang, Muhammad Jehanzeb Mirza, Yishu Gong, Yuan Gong et al.NeurIPS 2025 · 4 citations
Builds on24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness AssumptionsHongrui Chen, Holden Lee, Jianfeng LuICML 2023 · 212 citations
Related papers
- O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal AssumptionsGen Li, Yuling YanICLR 2025 · 1 citation
- Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic LocalizationJoe Benton, Valentin De Bortoli, Arnaud Doucet, George DeligiannidisICLR 2024 · 203 citations
- Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional DataMinshuo Chen, Kaixuan Huang, Tuo Zhao, Mengdi WangICML 2023 · 168 citations
- Learning Mixtures of Gaussians Using the DDPM ObjectiveKulin Shah, Sitan Chen, Adam R. KlivansNeurIPS 2023 · 69 citations
- Diffusion Models Are Statistically Optimal for Learning Low-Dimensional Multi-Modal DistributionsJingda Wu, Changxiao CaiICML 2026 · 1 citation
