A Unifying View of Variational Generative Wasserstein Flows
Paul Caucheteux, Clément Bonet, Anna Korba
摘要
Many modern generative models can be viewed as minimizing divergences between probability distributions, yet they rely on different algorithmic and geometric principles. Wasserstein gradient flows provide a continuous-time formulation for optimizing over distributions, and can be approximated through their implicit discretization via the Jordan–Kinderlehrer–Otto (JKO) scheme. In this work, we present a unified theoretical framework for generative modeling based on Wasserstein gradient flows, which we refer to as Generative Wasserstein Flows. We show that a broad class of existing methods can be derived as instances of parametric JKO schemes for f-divergences objectives, and we establish equivalences between several recently proposed algorithms. We extend this framework beyond f-divergences to integral probability metrics, deriving new JKO-based generative algorithms for objectives such as Maximum Mean Discrepancy. We also clarify their connections with GANs. Finally, we analyze parametric Wasserstein flows, where the evolution is restricted to distributions generated by parameterized maps. We characterize the resulting dynamics as projected or preconditioned Wasserstein gradient flows, highlighting the role of the Wasserstein geometry in shaping the learning dynamics of generative models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Optimal transport mapping via input convex neural networksAshok Vardhan Makkuva, Amirhossein Taghvaei, Sewoong Oh, Jason D. LeeICML 2020 · 被引用 254 次
- OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal TransportDerek Onken, Samy Wu Fung, Xingjian Li, Lars RuthottoAAAI 2021 · 被引用 210 次
- Wasserstein-2 Generative NetworksAlexander Korotin, Vage Egiazarian, Arip Asadulaev, Alexander Safin 等ICLR 2021 · 被引用 128 次
相关 Paper
- Learning Discrete Diffusion on Graphs via Free-Energy Gradient FlowsDario Rancati, Jan Maas, Francesco LocatelloICML 2026
- Normalizing flow neural networks by JKO schemeChen Xu, Xiuyuan Cheng, Yao XieNeurIPS 2023 · 被引用 51 次
- MonoFlow: Rethinking Divergence GANs via the Perspective of Wasserstein Gradient FlowsMingxuan Yi, Zhanxing Zhu, Song LiuICML 2023 · 被引用 18 次
- Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal TransportJaemoo Choi, Jaewoong Choi, Myungjoo KangICML 2024 · 被引用 20 次
- Large-Scale Wasserstein Gradient FlowsPetr Mokrov, Alexander Korotin, Lingxiao Li, Aude Genevay 等NeurIPS 2021 · 被引用 112 次
