A Kinetic-Energy Perspective of Flow Matching
Ziyun Li, Huancheng Hu, Soon Hoe Lim, Xuyu Li, Fei Gao, Enmao Diao, ZEZHEN DING, Michalis Vazirgiannis, Henrik Boström
摘要
Flow-based generative models can be viewed through a physics lens: sampling transports a particle from noise to data by integrating a learned velocity field, and each sample corresponds to a trajectory with its own dynamical effort. Motivated by classical mechanics, we introduce Kinetic Path Energy (KPE), an action-like, per-sample diagnostic that measures the accumulated kinetic effort along an ordinary differential equation (ODE) trajectory. Empirically, KPE exhibits two robust correspondences: (i) higher KPE predicts stronger semantic fidelity; (ii) high-KPE trajectories land in sparse representation regions. We further provide theoretical guarantees linking trajectory energy to data sparsity. Paradoxically, this correlation is non-monotonic. At sufficiently high energy, generation can degenerate into memorization. Leveraging the closed-form formula of empirical flow matching, we show that extreme energies drive trajectories toward near-copies of training examples. This yields a Goldilocks principle and motivates Kinetic Trajectory Shaping (KTS), a trainingfree two-phase inference strategy that boosts early motion and enforces a late-time soft landing, reducing memorization and improving generation quality across benchmark tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Multisample Flow Matching: Straightening Flows with Minibatch CouplingsAram-Alexandre Pooladian, Heli Ben-Hamu, Carles Domingo-Enrich, Brandon Amos 等ICML 2023 · 被引用 243 次
- Path Integral Sampler: A Stochastic Control Approach For SamplingQinsheng Zhang, Yongxin ChenICLR 2022 · 被引用 177 次
- Score-Based Generative Models Detect ManifoldsJakiw PidstrigachNeurIPS 2022 · 被引用 146 次
- Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in TrainingTony Bonnaire, Raphaël Urfin, Giulio Biroli, Marc MézardNeurIPS 2025 · 被引用 93 次
相关 Paper
- Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup FunctionalSanjeev Raja, Martin Sípka, Michael Psenka, Tobias Kreiman 等ICML 2025
- On Kinetic Optimal Probability Paths for Generative ModelsNeta Shaul, Ricky T. Q. Chen, Maximilian Nickel, Matthew Le 等ICML 2023 · 被引用 38 次
- Efficient Generative Modeling beyond Memoryless Diffusion via Adjoint Schrödinger Bridge MatchingJeongwoo Shin, Jinhwan Sul, Joonseok Lee, Jaewoong Choi 等ICML 2026
- FLAC: Maximum Entropy RL via Kinetic Energy Regularized Bridge MatchingLei Lyu, Yunfei Li, Yu Luo, Fuchun Sun 等ICML 2026 · 被引用 5 次
- Minimizing Trajectory Curvature of ODE-based Generative ModelsSangyun Lee, Beomsu Kim, Jong Chul YeICML 2023 · 被引用 84 次
