Preconditioned Langevin Dynamics with Score-based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems
Lorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten V. de Hoop
Abstract
Designing algorithms for solving high-dimensional Bayesian inverse problems directly in infinite-dimensional function spaces - where such problems are naturally formulated - is crucial to ensure stability and convergence as the discretization of the underlying problem is refined. In this paper, we contribute to this line of work by analyzing a widely used sampler for linear inverse problems: Langevin dynamics driven by score-based generative models (SGMs) acting as priors, formulated directly in function space. Building on the theoretical framework for SGMs in Hilbert spaces, we give a rigorous definition of this sampler in the infinite-dimensional setting and derive, for the first time, error estimates that explicitly depend on the approximation error of the score. As a consequence, we obtain sufficient conditions for global convergence in Kullback-Leibler divergence on the underlying function space. Preventing numerical instabilities requires preconditioning of the Langevin algorithm and we prove the existence and the form of an optimal preconditioner. The preconditioner depends on both the score error and the forward operator and guarantees a uniform convergence rate across all posterior modes. Our analysis applies to both Gaussian and a general class of non-Gaussian priors. Finally, we present examples that illustrate and validate our theoretical findings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Robust Compressed Sensing MRI with Deep Generative PriorsAjil Jalal, Marius Arvinte, Giannis Daras, Eric Price et al.NeurIPS 2021 · 483 citations
- SNIPS: Solving Noisy Inverse Problems StochasticallyBahjat Kawar, Gregory Vaksman, Michael EladNeurIPS 2021 · 263 citations
Related papers
- Conditional score-based diffusion models for Bayesian inference in infinite dimensionsLorenzo Baldassari, Ali Siahkoohi, Josselin Garnier, Knut Solna et al.NeurIPS 2023 · 56 citations
- On the Robustness of Langevin Dynamics to Score Function ErrorDaniel Cao, August Chen, Karthik Sridharan, Yuchen WuICML 2026 · 2 citations
- Wasserstein Convergence of Critically Damped Langevin DiffusionsStanislas Strasman, Sobihan Surendran, Claire Boyer, Sylvain Le Corff et al.NeurIPS 2025 · 5 citations
- Supervised Guidance Training for Infinite-Dimensional Diffusion ModelsElizabeth Baker, Alexander Denker, Jes FrellsenICML 2026 · 2 citations
- A Complete Recipe for Diffusion Generative ModelsKushagra Pandey, Stephan MandtICCV 2023 · 14 citations
