From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation
Rui Hu, Song Wu, Wen Yang, Jinjian Wu
Abstract
Estimating continuous optical flow is a fundamental yet challenging problem in dynamic visual perception. Event-based cameras, with microsecond latency and high dynamic range, capture brightness changes asynchronously, offering a unique opportunity to model motion with fine temporal precision. However, the scarcity of temporally dense ground-truth annotations limits the effectiveness of supervised learning, while contrast maximization (CM) frameworks, focused on sharpening the Image of Warped Events (IWE), often neglect temporal continuity and structural coherence, leading to distorted trajectories under complex motion. To overcome these challenges, we propose a hybrid-supervised framework for continuous-time optical flow estimation, grounded in the principle of Spatio-temporal Structural Consistency (STSC). This paradigm jointly enforces local structural stability and trajectory continuity, ensuring physically coherent motion across time. To further enhance representation and robustness, we design a bidirectionally complementary multi-scale architecture and employ a curriculum-guided hybrid training strategy, enabling a smooth transition from supervised point constraints to self-supervised manifold regularization. Comprehensive experiments across multiple benchmarks show that our method achieves state-of-the-art performance in both continuous-time and standard optical flow estimation, demonstrating the effectiveness of the proposed learning paradigm.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 73a96dda-3277-4cdf-bb58-ad967f33dd9cBuilds on11
- Time Lens++: Event-based Frame Interpolation with Parametric Nonlinear Flow and Multi-scale FusionStepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis et al.CVPR 2022 · 126 citations
- Flow-Guided Sparse Transformer for Video DeblurringJing Lin, Yuanhao Cai, Xiaowan Hu, Haoqian Wang et al.ICML 2022 · 82 citations
- Spatio-Temporal Recurrent Networks for Event-Based Optical Flow EstimationZiluo Ding, Rui Zhao, Jiyuan Zhang, Tianxiao Gao et al.AAAI 2022 · 76 citations
- TMA: Temporal Motion Aggregation for Event-based Optical FlowHaotian Liu, Guang Chen, Sanqing Qu, Yanping Zhang et al.ICCV 2023 · 48 citations
- Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical FlowFederico Paredes-Vallés, Kirk Y. W. Scheper, Christophe De Wagter, Guido C. H. E. de CroonICCV 2023 · 43 citations
Related papers
- Unsupervised 3d Motion Estimation Using Event CameraHan Han, Wei Zhai, Tiesong Zhao, Bin Li et al.CVPR 2026
- E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit RegularizationWenpu Li, Bangyan Liao, Yi Zhou, Qi Xu et al.NeurIPS 2025 · 4 citations
- Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural NetworksJesse J. Hagenaars, Federico Paredes-Vallés, Guido de CroonNeurIPS 2021 · 178 citations
- Unsupervised Joint Learning of Optical Flow and Intensity with Event CamerasShuang Guo, Friedhelm Hamann, Guillermo GallegoICCV 2025 · 3 citations
- Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric ConstancyFederico Paredes-Vallés, Guido C. H. E. de CroonCVPR 2021
