Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion
Adrien Vacher, Omar Chehab, Anna Korba
Abstract
Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in the parameters governing multi-modality, assuming fixed dimension. Our sampling algorithm simulates a time-reversed diffusion process, using a self-normalized Monte Carlo estimator of the intermediate score functions. Unlike previous works, it avoids metastability, requires no prior knowledge of the mode locations, and relaxes the well-known log-smoothness assumption which excluded general Gaussian mixtures so far.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0a3d226e-c824-4e3f-915d-d3f7555ffd2eCited by top-tier papers3
- Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyondWei Guo, Molei Tao, Yongxin ChenICLR 2026 · 12 citations
- Assessing the quality of denoising diffusion models in Wasserstein distance: noisy score and optimal boundsVahan Arsenyan, Elen Vardanyan, Arnak S. DalalyanNeurIPS 2025 · 6 citations
- Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin DynamicsLorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten de HoopICML 2026 · 2 citations
Builds on17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative ModelingValentin De Bortoli, James Thornton, Jeremy Heng, Arnaud DoucetNeurIPS 2021 · 811 citations
- Convergence for score-based generative modeling with polynomial complexityHolden Lee, Jianfeng Lu, Yixin TanNeurIPS 2022 · 221 citations
- Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness AssumptionsHongrui Chen, Holden Lee, Jianfeng LuICML 2023 · 212 citations
Related papers
- Reverse Diffusion Monte CarloXunpeng Huang, Hanze Dong, Yifan Hao, Yian Ma et al.ICLR 2024 · 46 citations
- Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising DiffusionYe He, Kevin Rojas, Molei TaoNeurIPS 2024 · 25 citations
- Query lower bounds for log-concave samplingSinho Chewi, Jaume de Dios Pont, Jerry Li, Chen Lu et al.FOCS 2023 · 2 citations
- High-accuracy sampling for diffusion models and log-concave distributionsFan Chen, Sinho Chewi, Constantinos Daskalakis, Alexander RakhlinICML 2026 · 12 citations
- Diffusive Gibbs SamplingWenlin Chen, Mingtian Zhang, Brooks Paige, José Miguel Hernández-Lobato et al.ICML 2024 · 21 citations
