FlowFM: Advancing Dark Optical Flow Estimation with Flow Matching
Fengyuan Zuo, Haiyan Jin, Yuanlin Zhang, Zhaolin Xiao, Bin Wang, Yuerong Mu
摘要
Dark optical flow estimation (DOFE) faces critical challenges: discriminative models are less robust to noise and struggle with weakened motion patterns, while diffusion models suffer from discontinuous flow fields and low efficiency. Flow matching (FM), though efficient, remains underexplored for conditional generation in DOFE. In this paper, we propose FlowFM, the first flow matching model tailored to DOFE tasks. Instead of conventional vector field regression, FlowFM proposes estimating the global transformation path constrained by the ground truth optical flow. It generates noisy flow by mixing Gaussian noise with ground truth, then performs a one-step denoising process conditioned on the initial flow field, cost volume, and contextual features for optimal accuracy and efficiency. FlowFM incorporates an implicit Fourier denoising decoder (IFDD) for reliable motion understanding. By leveraging the Fourier transform, IFDD uses amplitude to characterize motion intensity and phase to encode target spatial relationships within flow fields, then directly enhances amplitude to restore dark-caused motion information loss. Experiments show that FlowFM significantly outperforms state-of-the-art methods on the FCDN and VBOF benchmarks, setting a new performance record for DOFE.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Learning to Estimate Hidden Motions with Global Motion AggregationShihao Jiang, Dylan Campbell, Yao Lu, Hongdong Li 等ICCV 2021 · 被引用 402 次
- Seeing Dynamic Scene in the Dark: A High-Quality Video Dataset with Mechatronic AlignmentRuixing Wang, Xiaogang Xu, Chi-Wing Fu, Jiangbo Lu 等ICCV 2021 · 被引用 160 次
- Flow Matching for Generative ModelingYaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel 等ICLR 2023 · 被引用 87 次
- Global Matching with Overlapping Attention for Optical Flow EstimationShiyu Zhao, Long Zhao, Zhixing Zhang, Enyu Zhou 等CVPR 2022 · 被引用 85 次
- Learning Optical Flow with Adaptive Graph ReasoningAo Luo, Fan Yang, Kunming Luo, Xin Li 等AAAI 2022 · 被引用 73 次
相关 Paper
- FlowDiffuser: Advancing Optical Flow Estimation with Diffusion ModelsAo Luo, Xin Li, Fan Yang, Jiangyu Liu 等CVPR 2024 · 被引用 26 次
- Frequency-Aware Flow Matching for High-Quality Image GenerationSucheng Ren, Qihang Yu, Ju He, Xiaohui Shen 等CVPR 2026 · 被引用 6 次
- D-Flow: Differentiating through Flows for Controlled GenerationHeli Ben-Hamu, Omri Puny, Itai Gat, Brian Karrer 等ICML 2024 · 被引用 82 次
- Flowing from Words to Pixels: A Noise-Free Framework for Cross-Modality EvolutionQihao Liu, Xi Yin, Alan L. Yuille, Andrew Brown 等CVPR 2025
- BiFM: Bidirectional Flow Matching for Few-Step Image Editing and GenerationYasong Dai, Zeeshan Hayder, David Ahmedt-Aristizabal, Hongdong LiCVPR 2026 · 被引用 1 次
