Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence
Shiyuan Zhang, Qiwei Di, Xuheng Li, Quanquan Gu
Abstract
Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions , and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD typically scale polynomially with the ambient dimension , leading to vacuous bounds when is large. The main known dimension-free result concerns the randomized midpoint discretization in Wasserstein-2 distance (Liu et al., 2023), while dimension-independent guarantees for ULD discretizations in KL divergence have remained open. We close this gap by proving the first dimension-free KL divergence bounds for discretized ULD. Our analysis refines the KL local error framework (Altschuler et al., 2025) to a dimension-free setting and yields bounds that depend on , where upper bounds the Hessian of , rather than on . As a consequence, we obtain improved iteration complexity for underdamped Langevin Monte Carlo relative to overdamped Langevin methods in regimes where .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf21cbaf-361a-4d0a-bcb8-ac3e692b2b6fBuilds on10
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Neural Thompson SamplingWeitong Zhang, Dongruo Zhou, Lihong Li, Quanquan GuICLR 2021 · 152 citations
- Non-convex Learning via Replica Exchange Stochastic Gradient MCMCWei Deng, Qi Feng, Liyao Gao, Faming Liang et al.ICML 2020 · 54 citations
- Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMCArun Ganesh, Kunal TalwarNeurIPS 2020 · 44 citations
Related papers
- Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedLu Yu, Avetik G. Karagulyan, Arnak S. DalalyanICLR 2024 · 10 citations
- Shifted Composition IV: Toward Ballistic Acceleration for Log-Concave SamplingJason M. Altschuler, Sinho Chewi, Matthew S. ZhangSTOC 2026 · 9 citations
- Accelerating Langevin Monte Carlo via Efficient Stochastic Runge-Kutta Methods beyond Log-ConcavityBin Yang, Xiaojie WangICML 2026 · 1 citation
- Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower BoundsRishikesh Srinivasan, Dheeraj NagarajICLR 2026 · 3 citations
- Optimal Underdamped Langevin MCMC MethodZhengmian Hu, Feihu Huang, Heng HuangNeurIPS 2021 · 5 citations
