Lune

ICML2025顶会

Elucidating Flow Matching ODE Dynamics via Data Geometry and Denoisers

Zhengchao Wan, Qingsong Wang, Gal Mishne, Yusu Wang

问 Lune

摘要

Flow matching (FM) models extend ODE sampler based diffusion models into a general framework, significantly reducing sampling steps through learned vector fields. However, the theoretical understanding of FM models, particularly how their sample trajectories interact with underlying data geometry, remains underexplored. A rigorous theoretical analysis of FM ODE is essential for sample quality, stability, and broader applicability. In this paper, we advance the theory of FM models through a comprehensive analysis of sample trajectories. Central to our theory is the discovery that the denoiser, a key component of FM models, guides ODE dynamics through attracting and absorbing behaviors that adapt to the data geometry. We identify and analyze the three stages of ODE evolution: in the initial and intermediate stages, trajectories move toward the mean and local clusters of the data. At the terminal stage, we rigorously establish the convergence of FM ODE under weak assumptions, addressing scenarios where the data lie on a low-dimensional submanifold-cases that previous results could not handle. Our terminal stage analysis offers insights into the memorization phenomenon and establishes equivariance properties of FM ODEs. These findings bridge critical gaps in understanding flow matching models, with practical implications for optimizing sampling strategies and architectures guided by the intrinsic geometry of data.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 4 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper4

  1. Seeds of Structure: Patch PCA Reveals Universal Compositional Cues in Diffusion ModelsQingsong Wang, Zhengchao Wan, Misha Belkin, Yusu WangNeurIPS 2025 · 5 次引用
  2. Error Analysis of Discrete Flow with Generator MatchingZhengyan Wan, Yidong Ouyang, Qiang Yao, Liyan Xie 等ICML 2026 · 5 次引用
  3. Two Calm Ends and the Wild Middle: A Geometric Picture of Memorization in Diffusion ModelsNick Dodson, Xinyu Gao, Qingsong Wang, Yusu Wang 等ICML 2026 · 4 次引用
  4. A Kinetic-Energy Perspective of Flow MatchingZiyun Li, Huancheng Hu, Soon Hoe Lim, Xuyu Li 等ICML 2026

它引用的 Paper23

  1. Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 次引用
  2. Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 次引用
  3. Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 次引用
  4. Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 3,620 次引用
  5. DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen 等NeurIPS 2022 · 2,653 次引用

相关 Paper

  1. Flow matching achieves almost minimax optimal convergenceKenji Fukumizu, Taiji Suzuki, Noboru Isobe, Kazusato Oko 等ICLR 2025
  2. Interpreting and Improving Diffusion Models from an Optimization PerspectiveFrank Permenter, Chenyang YuanICML 2024 · 16 次引用
  3. From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle VelocityHaoming Liu, Jinnuo Liu, Yanhao Li, Liuyang Bai, Yunkai Ji, Yuanhe Guo, Shenji Wan, Hongyi WenCVPR Findings 2026 · 9 次引用
  4. On the Trajectory Regularity of ODE-based Diffusion SamplingDefang Chen, Zhenyu Zhou, Can Wang, Chunhua Shen 等ICML 2024 · 45 次引用
  5. Carré du champ flow matching: better quality-generalisation tradeoff in generative modelsJacob Bamberger, Iolo Jones, Dennis Duncan, Michael M. Bronstein 等ICLR 2026 · 14 次引用
黄昏的海面,两侧是细线勾勒的悬崖