Analytic Bijections for Smooth and Interpretable Normalizing Flows
Mathis Gerdes, Miranda C. N. Cheng
摘要
A key challenge in normalizing flows is finding expressive invertible scalar bijections. Existing approaches face trade-offs: affine transformations are smooth and analytically invertible but lack expressivity; monotonic splines offer local control but are only piecewise smooth and act on bounded domains; residual flows achieve smoothness but need numerical inversion. We introduce three families of analytic bijections that are globally smooth (), defined on all of , and analytically invertible in closed form, combining the favorable properties of prior approaches. Beyond serving as drop-in replacements in coupling flows, where they match or exceed spline performance, we develop radial flows: a novel architecture using direct parametrization that transforms the radial coordinate while preserving angular direction. Radial flows exhibit exceptional training stability, produce geometrically interpretable transformations, and on targets with radial structure can achieve comparable quality to coupling flows with fewer parameters. We provide comprehensive evaluation on 1D and 2D benchmarks, and demonstrate applicability to higher-dimensional physics problems through experiments on lattice field theory, where our bijections outperform affine baselines and enable problem-specific designs that address mode collapse.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Normalizing Flows on Tori and SpheresDanilo Jimenez Rezende, George Papamakarios, Sébastien Racanière, Michael S. Albergo 等ICML 2020 · 被引用 181 次
- Smooth Normalizing FlowsJonas Köhler, Andreas Krämer, Frank NoéNeurIPS 2021 · 被引用 73 次
- Representational aspects of depth and conditioning in normalizing flowsFrederic Koehler, Viraj Mehta, Andrej RisteskiICML 2021 · 被引用 29 次
- On the Robustness of Normalizing Flows for Inverse Problems in ImagingSeongmin Hong, Inbum Park, Se Young ChunICCV 2023 · 被引用 9 次
- Neural Diffeomorphic Non-uniform B-spline FlowsSeongmin Hong, Se Young ChunAAAI 2023 · 被引用 3 次
相关 Paper
- Relaxing Bijectivity Constraints with Continuously Indexed Normalising FlowsRobert Cornish, Anthony L. Caterini, George Deligiannidis, Arnaud DoucetICML 2020 · 被引用 141 次
- Implicit Normalizing FlowsCheng Lu, Jianfei Chen, Chongxuan Li, Qiuhao Wang 等ICLR 2021 · 被引用 38 次
- Universal Approximation Using Well-Conditioned Normalizing FlowsHolden Lee, Chirag Pabbaraju, Anish Prasad Sevekari, Andrej RisteskiNeurIPS 2021 · 被引用 15 次
- Densely connected normalizing flowsMatej Grcic, Ivan Grubisic, Sinisa SegvicNeurIPS 2021 · 被引用 67 次
- On the Universality of Volume-Preserving and Coupling-Based Normalizing FlowsFelix Draxler, Stefan Wahl, Christoph Schnörr, Ullrich KötheICML 2024 · 被引用 19 次
