Forward-KL Convergence of Time-Inhomogeneous Langevin Diffusions
Andreas Habring, Martin Zach
Abstract
Many practical samplers rely on time-dependent drifts---often induced by annealing or tempering schedules---to improve exploration and stability. This motivates a unified non-asymptotic analysis of the corresponding Langevin diffusion and their discretizations. We provide a convergence analysis that includes non-asymptotic bounds for the continuous-time diffusion and its Euler--Maruyama discretization in the forward-Kullback--Leibler divergence under a single set of abstract conditions on the time-dependent drift. The results apply to many practically-relevant annealing schemes, including geometric tempering and annealed Langevin sampling. In addition, we provide numerical experiments comparing the annealing schemes covered by our theory in low- as well as high-dimensional settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3926e187-dc2c-45b3-b615-898ab0f9f4f3Builds on4
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Posterior Sampling by Combining Diffusion Models with Annealed Langevin DynamicsZhiyang Xun, Shivam Gupta, Eric PriceNeurIPS 2025 · 8 citations
- Provable Convergence and Limitations of Geometric Tempering for Langevin DynamicsOmar Chehab, Anna Korba, Austin J. Stromme, Adrien VacherICLR 2025
- Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave SamplingWei Guo, Molei Tao, Yongxin ChenICLR 2025
Related papers
- Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin DynamicsLorenzo Baldassari, Josselin Garnier, Knut Solna, Maarten de HoopICML 2026 · 2 citations
- A connection between Tempering and Entropic Mirror DescentNicolas Chopin, Francesca R. Crucinio, Anna KorbaICML 2024 · 22 citations
- Mirror Langevin Monte Carlo: the Case Under IsoperimetryQijia JiangNeurIPS 2021 · 28 citations
- Discrete Diffusion Models: Novel Analysis and New Sampler GuaranteesYuchen Liang, Yingbin Liang, Lifeng Lai, Ness ShroffNeurIPS 2025 · 20 citations
- A Dynamical System View of Langevin-Based Non-Convex SamplingMohammad Reza Karimi Jaghargh, Ya-Ping Hsieh, Andreas KrauseNeurIPS 2023 · 4 citations
