EDCFlow: Exploring Temporally Dense Difference Maps for Event-based Optical Flow Estimation
Daikun Liu, Lei Cheng, Teng Wang, Changyin Sun
Abstract
Recent learning-based methods for event-based optical flow estimation utilize cost volumes for pixel matching but suffer from redundant computations and limited scalability to higher resolutions for flow refinement. In this work, we take advantage of the complementarity between temporally dense feature differences of adjacent event frames and cost volume and present a lightweight event-based optical flow network (EDCFlow) to achieve high-quality flow estimation at a higher resolution. Specifically, an attentionbased multi-scale temporal feature difference layer is developed to capture diverse motion patterns at high resolution in a computation-efficient manner. An adaptive fusion of high-resolution difference motion features and lowresolution correlation motion features is performed to enhance motion representation and model generalization. Notably, EDCFlow can serve as a plug-and-play refinement module for RAFT-like event-based methods to enhance flow details. Extensive experiments demonstrate that EDCFlow achieves better performance with lower complexity compared to existing methods, offering superior generalization. Codes and models will be available at here.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 56f45e21-06de-409d-9407-55fe1a191cc4Builds on11
- End-to-End Learning of Representations for Asynchronous Event-Based DataDaniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide ScaramuzzaICCV 2019 · 427 citations
- Learning to Estimate Hidden Motions with Global Motion AggregationShihao Jiang, Dylan Campbell, Yao Lu, Hongdong Li et al.ICCV 2021 · 402 citations
- CRAFT: Cross-Attentional Flow Transformer for Robust Optical FlowXiuchao Sui, Shaohua Li, Xue Geng, Yan Wu et al.CVPR 2022 · 114 citations
- Flow-Guided Sparse Transformer for Video DeblurringJing Lin, Yuanhao Cai, Xiaowan Hu, Haoqian Wang et al.ICML 2022 · 82 citations
- Spatio-Temporal Recurrent Networks for Event-Based Optical Flow EstimationZiluo Ding, Rui Zhao, Jiyuan Zhang, Tianxiao Gao et al.AAAI 2022 · 76 citations
Related papers
- TMA: Temporal Motion Aggregation for Event-based Optical FlowHaotian Liu, Guang Chen, Sanqing Qu, Yanping Zhang et al.ICCV 2023 · 48 citations
- Efficient Meshflow and Optical Flow Estimation from Event CamerasXinglong Luo, Ao Luo, Zhengning Wang, Chunyu Lin et al.CVPR 2024 · 10 citations
- GMFlow: Learning Optical Flow via Global MatchingHaofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi et al.CVPR 2022 · 353 citations
- BAT: Learning Event-based Optical Flow with Bidirectional Adaptive Temporal CorrelationGangwei Xu, Haotong Lin, Zhaoxing Zhang, Hongcheng Luo et al.AAAI 2026 · 1 citation
- Global Matching with Overlapping Attention for Optical Flow EstimationShiyu Zhao, Long Zhao, Zhixing Zhang, Enyu Zhou et al.CVPR 2022 · 85 citations
