Efficient constrained sampling via the mirror-Langevin algorithm
Kwangjun Ahn, Sinho Chewi
摘要
We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a new result in optimal transport that generalizes the displacement convexity of the entropy. Unlike prior works, our result both (1) requires much weaker assumptions on the mirror map and the target distribution, and (2) has vanishing bias as the step size tends to zero. In particular, for the task of sampling from a log-concave distribution supported on a compact set, our theoretical results are significantly better than the existing guarantees.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper30
- Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descentJason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. StrommeNeurIPS 2021 · 被引用 60 次
- Mirror Diffusion Models for Constrained and Watermarked GenerationGuan-Horng Liu, Tianrong Chen, Evangelos A. Theodorou, Molei TaoNeurIPS 2023 · 被引用 55 次
- KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint SupportPierre Glaser, Michael Arbel, Arthur GrettonNeurIPS 2021 · 被引用 49 次
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 被引用 47 次
- Mirror Langevin Monte Carlo: the Case Under IsoperimetryQijia JiangNeurIPS 2021 · 被引用 28 次
它引用的顶会 Paper4
- The Wasserstein Proximal Gradient AlgorithmAdil Salim, Anna Korba, Giulia LuiseNeurIPS 2020 · 被引用 74 次
- Exponential ergodicity of mirror-Langevin diffusionsSinho Chewi, Thibaut Le Gouic, Chen Lu, Tyler Maunu 等NeurIPS 2020 · 被引用 62 次
- Primal Dual Interpretation of the Proximal Stochastic Gradient Langevin AlgorithmAdil Salim, Peter RichtárikNeurIPS 2020 · 被引用 53 次
- Strong self-concordance and samplingAditi Laddha, Yin Tat Lee, Santosh S. VempalaSTOC 2020
相关 Paper
- Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedLu Yu, Avetik G. Karagulyan, Arnak S. DalalyanICLR 2024 · 被引用 10 次
- Sqrt(d) Dimension Dependence of Langevin Monte CarloRuilin Li, Hongyuan Zha, Molei TaoICLR 2022 · 被引用 36 次
- Optimal Underdamped Langevin MCMC MethodZhengmian Hu, Feihu Huang, Heng HuangNeurIPS 2021 · 被引用 5 次
- Faster high-accuracy log-concave sampling via algorithmic warm startsJason M. Altschuler, Sinho ChewiFOCS 2023 · 被引用 6 次
- Shifted Composition IV: Toward Ballistic Acceleration for Log-Concave SamplingJason M. Altschuler, Sinho Chewi, Matthew S. ZhangSTOC 2026 · 被引用 9 次
