Lune

ICML2026Top-tier venue

Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence

Shiyuan Zhang, Qiwei Di, Xuheng Li, Quanquan Gu

2026Year

Abstract

Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions π∝e−V\pi\propto e^{-V}, and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD typically scale polynomially with the ambient dimension dd, leading to vacuous bounds when dd is large. The main known dimension-free result concerns the randomized midpoint discretization in Wasserstein-2 distance (Liu et al., 2023), while dimension-independent guarantees for ULD discretizations in KL divergence have remained open. We close this gap by proving the first dimension-free KL divergence bounds for discretized ULD. Our analysis refines the KL local error framework (Altschuler et al., 2025) to a dimension-free setting and yields bounds that depend on tr(H)\mathrm{tr}(\mathbf{H}), where H\mathbf{H} upper bounds the Hessian of VV, rather than on dd. As a consequence, we obtain improved iteration complexity for underdamped Langevin Monte Carlo relative to overdamped Langevin methods in regimes where tr(H)≪d\mathrm{tr}(\mathbf{H})\ll d.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext cf21cbaf-361a-4d0a-bcb8-ac3e692b2b6f

Builds on10

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines