Convex Potential Mirror Langevin Algorithm for Efficient Sampling of Energy-Based Models
Zitao Yang, Amin Ullah, Shuai Li, Fuxin Li, Jun Li
摘要
This paper introduces the Convex Potential Mirror Langevin Algorithm (CPMLA), a novel method to improve sampling efficiency for Energy-Based Models (EBMs). CPMLA uses mirror Langevin dynamics with a convex potential flow as a dynamic mirror map for EBM sampling. This dynamic mirror map enables targeted geometric exploration on the data manifold, accelerating convergence to the target distribution. Theoretical analysis proves that CPMLA achieves exponential convergence with vanishing bias under relaxed log-concave conditions, supporting its efficiency in adapting to complex data distributions. Experiments on benchmarks like CIFAR-10, SVHN, and CelebA demonstrate CPMLA’s improved sampling quality and inference efficiency over existing techniques.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine 等NeurIPS 2020 · 被引用 2,345 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Learning Latent Space Energy-Based Prior ModelBo Pang, Tian Han, Erik Nijkamp, Song-Chun Zhu 等NeurIPS 2020 · 被引用 152 次
- Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex OptimizationChin-Wei Huang, Ricky T. Q. Chen, Christos Tsirigotis, Aaron C. CourvilleICLR 2021 · 被引用 107 次
- Efficient constrained sampling via the mirror-Langevin algorithmKwangjun Ahn, Sinho ChewiNeurIPS 2021 · 被引用 77 次
相关 Paper
- Bregman Proximal Langevin Monte Carlo via Bregman-Moreau EnvelopesTim Tsz-Kit Lau, Han LiuICML 2022 · 被引用 11 次
- Learning Energy-Based Model with Variational Auto-Encoder as Amortized SamplerJianwen Xie, Zilong Zheng, Ping LiAAAI 2021 · 被引用 57 次
- Faster Sampling via Stochastic Gradient Proximal SamplerXunpeng Huang, Difan Zou, Hanze Dong, Yian Ma 等ICML 2024 · 被引用 4 次
- PID-controlled Langevin Dynamics for Faster Sampling of Generative ModelsHongyi Chen, Jianhai Shu, Jingtao Ding, Yong Li 等NeurIPS 2025 · 被引用 1 次
- Learning Energy-based Model via Dual-MCMC TeachingJiali Cui, Tian HanNeurIPS 2023 · 被引用 14 次
