Asymptotically exact variational flows via involutive MCMC kernels
Zuheng Xu, Trevor Campbell
Abstract
Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present a general recipe for constructing tuning-free, asymptotically exact variational flows on arbitrary state spaces from involutive MCMC kernels. The core methodological component is a novel representation of general involutive MCMC kernels as invertible, measurepreserving iterated random function systems, which act as the flow maps of our variational flows. This leads to three new variational families with provable total variation convergence. Our framework resolves key practical limitations of existing variational families with similar guarantees (e.g., MixFlows), while requiring substantially weaker theoretical assumptions. Finally, we demonstrate the competitive performance of our flows across tasks including posterior approximation, Monte Carlo estimates, and normalization constant estimation, outperforming or matching No-U-Turn sampler (NUTS) and black-box normalizing flows.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ace85349-8031-4020-8312-96ddf981211cBuilds on15
- Annealed Flow Transport Monte CarloMichael Arbel, Alexander G. de G. Matthews, Arnaud DoucetICML 2021 · 99 citations
- Continual Repeated Annealed Flow Transport Monte CarloAlexander G. de G. Matthews, Michael Arbel, Danilo Jimenez Rezende, Arnaud DoucetICML 2022 · 69 citations
- Monte Carlo Variational Auto-EncodersAchille Thin, Nikita Kotelevskii, Arnaud Doucet, Alain Durmus et al.ICML 2021 · 51 citations
- Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and OptimizationAbhinav Agrawal, Daniel Sheldon, Justin DomkeNeurIPS 2020 · 49 citations
- Differentiable Annealed Importance Sampling and the Perils of Gradient NoiseGuodong Zhang, Kyle Hsu, Jianing Li, Chelsea Finn et al.NeurIPS 2021 · 46 citations
Related papers
- MixFlows: principled variational inference via mixed flowsZuheng Xu, Naitong Chen, Trevor CampbellICML 2023 · 11 citations
- Stochastic Normalizing FlowsHao Wu, Jonas Köhler, Frank NoéNeurIPS 2020 · 230 citations
- Neural Posterior Estimation with Latent Basis ExpansionsDeclan McNamara, Yicun Duan, Jeffrey RegierICLR 2026
- Variational inference via Wasserstein gradient flowsMarc Lambert, Sinho Chewi, Francis R. Bach, Silvère Bonnabel et al.NeurIPS 2022 · 123 citations
- Implicit Normalizing FlowsCheng Lu, Jianfei Chen, Chongxuan Li, Qiuhao Wang et al.ICLR 2021 · 38 citations
