Elucidating Flow Matching ODE Dynamics via Data Geometry and Denoisers
Zhengchao Wan, Qingsong Wang, Gal Mishne, Yusu Wang
Abstract
Flow matching (FM) models extend ODE sampler based diffusion models into a general framework, significantly reducing sampling steps through learned vector fields. However, the theoretical understanding of FM models, particularly how their sample trajectories interact with underlying data geometry, remains underexplored. A rigorous theoretical analysis of FM ODE is essential for sample quality, stability, and broader applicability. In this paper, we advance the theory of FM models through a comprehensive analysis of sample trajectories. Central to our theory is the discovery that the denoiser, a key component of FM models, guides ODE dynamics through attracting and absorbing behaviors that adapt to the data geometry. We identify and analyze the three stages of ODE evolution: in the initial and intermediate stages, trajectories move toward the mean and local clusters of the data. At the terminal stage, we rigorously establish the convergence of FM ODE under weak assumptions, addressing scenarios where the data lie on a low-dimensional submanifold-cases that previous results could not handle. Our terminal stage analysis offers insights into the memorization phenomenon and establishes equivariance properties of FM ODEs. These findings bridge critical gaps in understanding flow matching models, with practical implications for optimizing sampling strategies and architectures guided by the intrinsic geometry of data.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 4 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers4
- Seeds of Structure: Patch PCA Reveals Universal Compositional Cues in Diffusion ModelsQingsong Wang, Zhengchao Wan, Misha Belkin, Yusu WangNeurIPS 2025 · 5 citations
- Error Analysis of Discrete Flow with Generator MatchingZhengyan Wan, Yidong Ouyang, Qiang Yao, Liyan Xie et al.ICML 2026 · 5 citations
- Two Calm Ends and the Wild Middle: A Geometric Picture of Memorization in Diffusion ModelsNick Dodson, Xinyu Gao, Qingsong Wang, Yusu Wang et al.ICML 2026 · 4 citations
- A Kinetic-Energy Perspective of Flow MatchingZiyun Li, Huancheng Hu, Soon Hoe Lim, Xuyu Li et al.ICML 2026
Builds on23
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen et al.NeurIPS 2022 · 2,653 citations
Related papers
- Flow matching achieves almost minimax optimal convergenceKenji Fukumizu, Taiji Suzuki, Noboru Isobe, Kazusato Oko et al.ICLR 2025
- Interpreting and Improving Diffusion Models from an Optimization PerspectiveFrank Permenter, Chenyang YuanICML 2024 · 16 citations
- From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle VelocityHaoming Liu, Jinnuo Liu, Yanhao Li, Liuyang Bai, Yunkai Ji, Yuanhe Guo, Shenji Wan, Hongyi WenCVPR Findings 2026 · 9 citations
- On the Trajectory Regularity of ODE-based Diffusion SamplingDefang Chen, Zhenyu Zhou, Can Wang, Chunhua Shen et al.ICML 2024 · 45 citations
- Carré du champ flow matching: better quality-generalisation tradeoff in generative modelsJacob Bamberger, Iolo Jones, Dennis Duncan, Michael M. Bronstein et al.ICLR 2026 · 14 citations
