Asymptotically exact variational flows via involutive MCMC kernels
Zuheng Xu, Trevor Campbell
摘要
Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present a general recipe for constructing tuning-free, asymptotically exact variational flows on arbitrary state spaces from involutive MCMC kernels. The core methodological component is a novel representation of general involutive MCMC kernels as invertible, measurepreserving iterated random function systems, which act as the flow maps of our variational flows. This leads to three new variational families with provable total variation convergence. Our framework resolves key practical limitations of existing variational families with similar guarantees (e.g., MixFlows), while requiring substantially weaker theoretical assumptions. Finally, we demonstrate the competitive performance of our flows across tasks including posterior approximation, Monte Carlo estimates, and normalization constant estimation, outperforming or matching No-U-Turn sampler (NUTS) and black-box normalizing flows.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Annealed Flow Transport Monte CarloMichael Arbel, Alexander G. de G. Matthews, Arnaud DoucetICML 2021 · 被引用 99 次
- Continual Repeated Annealed Flow Transport Monte CarloAlexander G. de G. Matthews, Michael Arbel, Danilo Jimenez Rezende, Arnaud DoucetICML 2022 · 被引用 69 次
- Monte Carlo Variational Auto-EncodersAchille Thin, Nikita Kotelevskii, Arnaud Doucet, Alain Durmus 等ICML 2021 · 被引用 51 次
- Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and OptimizationAbhinav Agrawal, Daniel Sheldon, Justin DomkeNeurIPS 2020 · 被引用 49 次
- Differentiable Annealed Importance Sampling and the Perils of Gradient NoiseGuodong Zhang, Kyle Hsu, Jianing Li, Chelsea Finn 等NeurIPS 2021 · 被引用 46 次
相关 Paper
- MixFlows: principled variational inference via mixed flowsZuheng Xu, Naitong Chen, Trevor CampbellICML 2023 · 被引用 11 次
- Stochastic Normalizing FlowsHao Wu, Jonas Köhler, Frank NoéNeurIPS 2020 · 被引用 230 次
- Neural Posterior Estimation with Latent Basis ExpansionsDeclan McNamara, Yicun Duan, Jeffrey RegierICLR 2026
- Variational inference via Wasserstein gradient flowsMarc Lambert, Sinho Chewi, Francis R. Bach, Silvère Bonnabel 等NeurIPS 2022 · 被引用 123 次
- Implicit Normalizing FlowsCheng Lu, Jianfei Chen, Chongxuan Li, Qiuhao Wang 等ICLR 2021 · 被引用 38 次
