Convex Potential Mirror Langevin Algorithm for Efficient Sampling of Energy-Based Models
Zitao Yang, Amin Ullah, Shuai Li, Fuxin Li, Jun Li
Abstract
This paper introduces the Convex Potential Mirror Langevin Algorithm (CPMLA), a novel method to improve sampling efficiency for Energy-Based Models (EBMs). CPMLA uses mirror Langevin dynamics with a convex potential flow as a dynamic mirror map for EBM sampling. This dynamic mirror map enables targeted geometric exploration on the data manifold, accelerating convergence to the target distribution. Theoretical analysis proves that CPMLA achieves exponential convergence with vanishing bias under relaxed log-concave conditions, supporting its efficiency in adapting to complex data distributions. Experiments on benchmarks like CIFAR-10, SVHN, and CelebA demonstrate CPMLA’s improved sampling quality and inference efficiency over existing techniques.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Learning Latent Space Energy-Based Prior ModelBo Pang, Tian Han, Erik Nijkamp, Song-Chun Zhu et al.NeurIPS 2020 · 152 citations
- Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex OptimizationChin-Wei Huang, Ricky T. Q. Chen, Christos Tsirigotis, Aaron C. CourvilleICLR 2021 · 107 citations
- Efficient constrained sampling via the mirror-Langevin algorithmKwangjun Ahn, Sinho ChewiNeurIPS 2021 · 77 citations
Related papers
- Bregman Proximal Langevin Monte Carlo via Bregman-Moreau EnvelopesTim Tsz-Kit Lau, Han LiuICML 2022 · 11 citations
- Learning Energy-Based Model with Variational Auto-Encoder as Amortized SamplerJianwen Xie, Zilong Zheng, Ping LiAAAI 2021 · 57 citations
- Faster Sampling via Stochastic Gradient Proximal SamplerXunpeng Huang, Difan Zou, Hanze Dong, Yian Ma et al.ICML 2024 · 4 citations
- PID-controlled Langevin Dynamics for Faster Sampling of Generative ModelsHongyi Chen, Jianhai Shu, Jingtao Ding, Yong Li et al.NeurIPS 2025 · 1 citation
- Learning Energy-based Model via Dual-MCMC TeachingJiali Cui, Tian HanNeurIPS 2023 · 14 citations
