The probability flow ODE is provably fast
Sitan Chen, Sinho Chewi, Holden Lee, Yuanzhi Li, Jianfeng Lu, Adil Salim
摘要
We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining such guarantees for the SDE-based implementation (i.e., denoising diffusion probabilistic modeling or DDPM), but requires the development of novel techniques for studying deterministic dynamics without contractivity. Through the use of a specially chosen corrector step based on the underdamped Langevin diffusion, we obtain better dimension dependence than prior works on DDPM ( vs. , assuming smoothness of the data distribution), highlighting potential advantages of the ODE framework.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper65
- Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic LocalizationJoe Benton, Valentin De Bortoli, Arnaud Doucet, George DeligiannidisICLR 2024 · 被引用 203 次
- Gradient Guidance for Diffusion Models: An Optimization PerspectiveYingqing Guo, Hui Yuan, Yukang Yang, Minshuo Chen 等NeurIPS 2024 · 被引用 79 次
- Learning Mixtures of Gaussians Using the DDPM ObjectiveKulin Shah, Sitan Chen, Adam R. KlivansNeurIPS 2023 · 被引用 69 次
- Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time ComplexityHaoxuan Chen, Yinuo Ren, Lexing Ying, Grant M. RotskoffNeurIPS 2024 · 被引用 53 次
- What does guidance do? A fine-grained analysis in a simple settingMuthu Chidambaram, Khashayar Gatmiry, Sitan Chen, Holden Lee 等NeurIPS 2024 · 被引用 53 次
它引用的顶会 Paper20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen 等NeurIPS 2022 · 被引用 2,653 次
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow 等NeurIPS 2021 · 被引用 2,256 次
相关 Paper
- Towards Non-Asymptotic Convergence for Diffusion-Based Generative ModelsGen Li, Yuting Wei, Yuxin Chen, Yuejie ChiICLR 2024 · 被引用 39 次
- O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal AssumptionsGen Li, Yuling YanICLR 2025 · 被引用 1 次
- Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionsSitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li 等ICLR 2023 · 被引用 15 次
- Convergence for score-based generative modeling with polynomial complexityHolden Lee, Jianfeng Lu, Yixin TanNeurIPS 2022 · 被引用 221 次
- Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion ModelsGen Li, Yuling YanNeurIPS 2024 · 被引用 66 次
