Preconditioned Langevin Dynamics with Score-based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems
Lorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten V. de Hoop
摘要
Designing algorithms for solving high-dimensional Bayesian inverse problems directly in infinite-dimensional function spaces - where such problems are naturally formulated - is crucial to ensure stability and convergence as the discretization of the underlying problem is refined. In this paper, we contribute to this line of work by analyzing a widely used sampler for linear inverse problems: Langevin dynamics driven by score-based generative models (SGMs) acting as priors, formulated directly in function space. Building on the theoretical framework for SGMs in Hilbert spaces, we give a rigorous definition of this sampler in the infinite-dimensional setting and derive, for the first time, error estimates that explicitly depend on the approximation error of the score. As a consequence, we obtain sufficient conditions for global convergence in Kullback-Leibler divergence on the underlying function space. Preventing numerical instabilities requires preconditioning of the Langevin algorithm and we prove the existence and the form of an optimal preconditioner. The preconditioner depends on both the score error and the forward operator and guarantees a uniform convergence rate across all posterior modes. Our analysis applies to both Gaussian and a general class of non-Gaussian priors. Finally, we present examples that illustrate and validate our theoretical findings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper11
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 被引用 1,527 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Robust Compressed Sensing MRI with Deep Generative PriorsAjil Jalal, Marius Arvinte, Giannis Daras, Eric Price 等NeurIPS 2021 · 被引用 483 次
- SNIPS: Solving Noisy Inverse Problems StochasticallyBahjat Kawar, Gregory Vaksman, Michael EladNeurIPS 2021 · 被引用 263 次
相关 Paper
- Conditional score-based diffusion models for Bayesian inference in infinite dimensionsLorenzo Baldassari, Ali Siahkoohi, Josselin Garnier, Knut Solna 等NeurIPS 2023 · 被引用 56 次
- On the Robustness of Langevin Dynamics to Score Function ErrorDaniel Cao, August Chen, Karthik Sridharan, Yuchen WuICML 2026 · 被引用 2 次
- Wasserstein Convergence of Critically Damped Langevin DiffusionsStanislas Strasman, Sobihan Surendran, Claire Boyer, Sylvain Le Corff 等NeurIPS 2025 · 被引用 5 次
- Supervised Guidance Training for Infinite-Dimensional Diffusion ModelsElizabeth Baker, Alexander Denker, Jes FrellsenICML 2026 · 被引用 2 次
- A Complete Recipe for Diffusion Generative ModelsKushagra Pandey, Stephan MandtICCV 2023 · 被引用 14 次
