Adapting Noise to Data: Generative Flows from Learned 1D Processes
Jannis Chemseddine, Gregor Kornhardt, Richard Duong, Gabriele Steidl
Abstract
The default Gaussian latent in flow-based generative models poses challenges when learning certain distributions such as heavy-tailed ones. We introduce a general framework for learning data-adaptive parametric prior distributions (latent noise) using one-dimensional quantile functions, optimized via the Wasserstein distance between noise and data. The quantile-based prior parameterization naturally adapts to both heavy-tailed and compactly supported distributions and shortens transport paths. Numerical results on heavy-tailed weather and image datasets confirm the method’s flexibility and effectiveness achieved with negligible computational overhead.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on25
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow et al.NeurIPS 2021 · 2,256 citations
Related papers
- Tail Annealing for Heavy-Tailed Flow MatchingJean PachebatICML 2026
- Marginal Tail-Adaptive Normalizing FlowsMike Laszkiewicz, Johannes Lederer, Asja FischerICML 2022 · 12 citations
- Learning to Dequantise with Truncated FlowsShawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron C. CourvilleICLR 2022 · 4 citations
- Distributional Learning of Variational AutoEncoder: Application to Synthetic Data GenerationSeunghwan An, Jong-June JeonNeurIPS 2023 · 19 citations
- Autoregressive Quantile Flows for Predictive Uncertainty EstimationPhillip Si, Allan Bishop, Volodymyr KuleshovICLR 2022 · 22 citations
