Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence
Shiyuan Zhang, Qiwei Di, Xuheng Li, Quanquan Gu
摘要
Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions , and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD typically scale polynomially with the ambient dimension , leading to vacuous bounds when is large. The main known dimension-free result concerns the randomized midpoint discretization in Wasserstein-2 distance (Liu et al., 2023), while dimension-independent guarantees for ULD discretizations in KL divergence have remained open. We close this gap by proving the first dimension-free KL divergence bounds for discretized ULD. Our analysis refines the KL local error framework (Altschuler et al., 2025) to a dimension-free setting and yields bounds that depend on , where upper bounds the Hessian of , rather than on . As a consequence, we obtain improved iteration complexity for underdamped Langevin Monte Carlo relative to overdamped Langevin methods in regimes where .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Neural Thompson SamplingWeitong Zhang, Dongruo Zhou, Lihong Li, Quanquan GuICLR 2021 · 被引用 152 次
- Non-convex Learning via Replica Exchange Stochastic Gradient MCMCWei Deng, Qi Feng, Liyao Gao, Faming Liang 等ICML 2020 · 被引用 54 次
- Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMCArun Ganesh, Kunal TalwarNeurIPS 2020 · 被引用 44 次
相关 Paper
- Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedLu Yu, Avetik G. Karagulyan, Arnak S. DalalyanICLR 2024 · 被引用 10 次
- Shifted Composition IV: Toward Ballistic Acceleration for Log-Concave SamplingJason M. Altschuler, Sinho Chewi, Matthew S. ZhangSTOC 2026 · 被引用 9 次
- Accelerating Langevin Monte Carlo via Efficient Stochastic Runge-Kutta Methods beyond Log-ConcavityBin Yang, Xiaojie WangICML 2026 · 被引用 1 次
- Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower BoundsRishikesh Srinivasan, Dheeraj NagarajICLR 2026 · 被引用 3 次
- Optimal Underdamped Langevin MCMC MethodZhengmian Hu, Feihu Huang, Heng HuangNeurIPS 2021 · 被引用 5 次
