Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamics
Lorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten de Hoop
Abstract
Designing sampling algorithms for multimodal targets that remain stable under refinement of the finite-dimensional approximation of an underlying function-space problem is a central challenge. Annealed Langevin dynamics (ALD) is a natural alternative to classical Langevin in this context, since it is often observed to improve exploration across modes. Yet a gap remains between its empirical success and existing theory: under which conditions can ALD be guaranteed to remain stable across dimensions? In this paper, we bridge this gap by providing a uniform-in-dimension analysis of continuous-time ALD for Gaussian-mixture targets. Along an explicit annealing path obtained by gradually removing Gaussian smoothing from the target, we identify spectral conditions linking the smoothing covariance to the component covariances under which ALD achieves a prescribed accuracy in Kullback-Leibler divergence within a dimension-uniform time horizon. We then establish stability in a perturbative regime with imperfect initialization and approximate scores. Under a misspecified-mixture score model, we show that preconditioning ALD with an operator whose spectrum decays sufficiently fast prevents error terms from accumulating across coordinates and thereby preserves dimension-uniform control.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Conditional score-based diffusion models for Bayesian inference in infinite dimensionsLorenzo Baldassari, Ali Siahkoohi, Josselin Garnier, Knut Solna et al.NeurIPS 2023 · 56 citations
- Theoretical insights for diffusion guidance: A case study for Gaussian mixture modelsYuchen Wu, Minshuo Chen, Zihao Li, Mengdi Wang et al.ICML 2024 · 47 citations
- Continuous-Time Functional Diffusion ProcessesGiulio Franzese, Giulio Corallo, Simone Rossi, Markus Heinonen et al.NeurIPS 2023 · 45 citations
- ∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified StatesSam Bond-Taylor, Chris G. WillcocksICLR 2024 · 28 citations
Related papers
- Preconditioned Langevin Dynamics with Score-based Generative Models for Infinite-Dimensional Linear Bayesian Inverse ProblemsLorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten V. de HoopNeurIPS 2025 · 5 citations
- Forward-KL Convergence of Time-Inhomogeneous Langevin DiffusionsAndreas Habring, Martin ZachICML 2026 · 2 citations
- Provable Convergence and Limitations of Geometric Tempering for Langevin DynamicsOmar Chehab, Anna Korba, Austin J. Stromme, Adrien VacherICLR 2025
- Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave SamplingWei Guo, Molei Tao, Yongxin ChenICLR 2025
- NETS: A Non-equilibrium Transport SamplerMichael Samuel Albergo, Eric Vanden-EijndenICML 2025
