On the Closed-Form of Flow Matching: Generalization Does Not Arise from Target Stochasticity
Quentin Bertrand, Anne Gagneux, Mathurin Massias, Rémi Emonet
摘要
Modern deep generative models can now produce high-quality synthetic samples that are often indistinguishable from real training data. A growing body of research aims to understand why recent methods, such as diffusion and flow matching techniques, generalize so effectively. Among the proposed explanations are the inductive biases of deep learning architectures and the stochastic nature of the conditional flow matching loss. In this work, we rule out the noisy nature of the loss as a key factor driving generalization in flow matching. First, we empirically show that in high-dimensional settings, the stochastic and closed-form versions of the flow matching loss yield nearly equivalent losses. Then, using state-of-the-art flow matching models on standard image datasets, we demonstrate that both variants achieve comparable statistical performance, with the surprising observation that using the closed-form can even improve performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper14
- Generalization of Diffusion Models Arises with a Balanced Representation SpaceZekai Zhang, Xiao Li, Xiang Li, Lianghe Shi 等ICLR 2026 · 被引用 14 次
- Carré du champ flow matching: better quality-generalisation tradeoff in generative modelsJacob Bamberger, Iolo Jones, Dennis Duncan, Michael M. Bronstein 等ICLR 2026 · 被引用 14 次
- Two Calm Ends and the Wild Middle: A Geometric Picture of Memorization in Diffusion ModelsNick Dodson, Xinyu Gao, Qingsong Wang, Yusu Wang 等ICML 2026 · 被引用 4 次
- PairFlow: Closed-Form Source-Target Coupling for Few-Step Generation in Discrete Flow ModelsMingue Park, Jisung Hwang, Seungwoo Yoo, Kyeongmin Yeo 等ICLR 2026 · 被引用 4 次
- Local Mechanisms of Compositional GeneralizationArwen BradleyICML 2026 · 被引用 3 次
它引用的顶会 Paper27
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 被引用 5,234 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Understanding and Mitigating Copying in Diffusion ModelsGowthami Somepalli, Vasu Singla, Micah Goldblum, Jonas Geiping 等NeurIPS 2023 · 被引用 265 次
- Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelsGeorge Stein, Jesse C. Cresswell, Rasa Hosseinzadeh, Yi Sui 等NeurIPS 2023 · 被引用 260 次
相关 Paper
- Flowing from Words to Pixels: A Noise-Free Framework for Cross-Modality EvolutionQihao Liu, Xi Yin, Alan L. Yuille, Andrew Brown 等CVPR 2025
- DepthFM: Fast Generative Monocular Depth Estimation with Flow MatchingMing Gui, Johannes Schusterbauer, Ulrich Prestel, Pingchuan Ma 等AAAI 2025 · 被引用 51 次
- Flow Matching for Generative ModelingYaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel 等ICLR 2023 · 被引用 87 次
- Generator Matching: Generative modeling with arbitrary Markov processesPeter Holderrieth, Marton Havasi, Jason Yim, Neta Shaul 等ICLR 2025
- Inductive Moment MatchingLinqi Zhou, Stefano Ermon, Jiaming SongICML 2025
