Efficient constrained sampling via the mirror-Langevin algorithm
Kwangjun Ahn, Sinho Chewi
Abstract
We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a new result in optimal transport that generalizes the displacement convexity of the entropy. Unlike prior works, our result both (1) requires much weaker assumptions on the mirror map and the target distribution, and (2) has vanishing bias as the step size tends to zero. In particular, for the task of sampling from a log-concave distribution supported on a compact set, our theoretical results are significantly better than the existing guarantees.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext af7303ba-76de-445e-841a-f8feaa6c7d80Cited by top-tier papers30
- Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descentJason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. StrommeNeurIPS 2021 · 60 citations
- Mirror Diffusion Models for Constrained and Watermarked GenerationGuan-Horng Liu, Tianrong Chen, Evangelos A. Theodorou, Molei TaoNeurIPS 2023 · 55 citations
- KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint SupportPierre Glaser, Michael Arbel, Arthur GrettonNeurIPS 2021 · 49 citations
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 47 citations
- Mirror Langevin Monte Carlo: the Case Under IsoperimetryQijia JiangNeurIPS 2021 · 28 citations
Builds on4
- The Wasserstein Proximal Gradient AlgorithmAdil Salim, Anna Korba, Giulia LuiseNeurIPS 2020 · 74 citations
- Exponential ergodicity of mirror-Langevin diffusionsSinho Chewi, Thibaut Le Gouic, Chen Lu, Tyler Maunu et al.NeurIPS 2020 · 62 citations
- Primal Dual Interpretation of the Proximal Stochastic Gradient Langevin AlgorithmAdil Salim, Peter RichtárikNeurIPS 2020 · 53 citations
- Strong self-concordance and samplingAditi Laddha, Yin Tat Lee, Santosh S. VempalaSTOC 2020
Related papers
- Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisitedLu Yu, Avetik G. Karagulyan, Arnak S. DalalyanICLR 2024 · 10 citations
- Sqrt(d) Dimension Dependence of Langevin Monte CarloRuilin Li, Hongyuan Zha, Molei TaoICLR 2022 · 36 citations
- Optimal Underdamped Langevin MCMC MethodZhengmian Hu, Feihu Huang, Heng HuangNeurIPS 2021 · 5 citations
- Faster high-accuracy log-concave sampling via algorithmic warm startsJason M. Altschuler, Sinho ChewiFOCS 2023 · 6 citations
- Shifted Composition IV: Toward Ballistic Acceleration for Log-Concave SamplingJason M. Altschuler, Sinho Chewi, Matthew S. ZhangSTOC 2026 · 9 citations
