From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation
Rui Hu, Song Wu, Wen Yang, Jinjian Wu
摘要
Estimating continuous optical flow is a fundamental yet challenging problem in dynamic visual perception. Event-based cameras, with microsecond latency and high dynamic range, capture brightness changes asynchronously, offering a unique opportunity to model motion with fine temporal precision. However, the scarcity of temporally dense ground-truth annotations limits the effectiveness of supervised learning, while contrast maximization (CM) frameworks, focused on sharpening the Image of Warped Events (IWE), often neglect temporal continuity and structural coherence, leading to distorted trajectories under complex motion. To overcome these challenges, we propose a hybrid-supervised framework for continuous-time optical flow estimation, grounded in the principle of Spatio-temporal Structural Consistency (STSC). This paradigm jointly enforces local structural stability and trajectory continuity, ensuring physically coherent motion across time. To further enhance representation and robustness, we design a bidirectionally complementary multi-scale architecture and employ a curriculum-guided hybrid training strategy, enabling a smooth transition from supervised point constraints to self-supervised manifold regularization. Comprehensive experiments across multiple benchmarks show that our method achieves state-of-the-art performance in both continuous-time and standard optical flow estimation, demonstrating the effectiveness of the proposed learning paradigm.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Time Lens++: Event-based Frame Interpolation with Parametric Nonlinear Flow and Multi-scale FusionStepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis 等CVPR 2022 · 被引用 126 次
- Flow-Guided Sparse Transformer for Video DeblurringJing Lin, Yuanhao Cai, Xiaowan Hu, Haoqian Wang 等ICML 2022 · 被引用 82 次
- Spatio-Temporal Recurrent Networks for Event-Based Optical Flow EstimationZiluo Ding, Rui Zhao, Jiyuan Zhang, Tianxiao Gao 等AAAI 2022 · 被引用 76 次
- TMA: Temporal Motion Aggregation for Event-based Optical FlowHaotian Liu, Guang Chen, Sanqing Qu, Yanping Zhang 等ICCV 2023 · 被引用 48 次
- Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical FlowFederico Paredes-Vallés, Kirk Y. W. Scheper, Christophe De Wagter, Guido C. H. E. de CroonICCV 2023 · 被引用 43 次
相关 Paper
- Unsupervised 3d Motion Estimation Using Event CameraHan Han, Wei Zhai, Tiesong Zhao, Bin Li 等CVPR 2026
- E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit RegularizationWenpu Li, Bangyan Liao, Yi Zhou, Qi Xu 等NeurIPS 2025 · 被引用 4 次
- Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural NetworksJesse J. Hagenaars, Federico Paredes-Vallés, Guido de CroonNeurIPS 2021 · 被引用 178 次
- Unsupervised Joint Learning of Optical Flow and Intensity with Event CamerasShuang Guo, Friedhelm Hamann, Guillermo GallegoICCV 2025 · 被引用 3 次
- Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric ConstancyFederico Paredes-Vallés, Guido C. H. E. de CroonCVPR 2021
