One-Shot Flow, Any-Time Frame: A Bidirectional Warping Framework for Event-Based Video Frame Interpolation
Linghui Fu, Yuhan Liu, Hao Chen, Zhen Yang, Yongjian Deng
Abstract
Video Frame Interpolation (VFI) is a crucial task in video processing. Flow-based methods, despite their success, are constrained by a fundamental dilemma: forward warping is efficient but prone to artifacts, while backward warping yields higher quality at a significant computational cost, especially for multi-frame interpolation. This trade-off is a major bottleneck. To overcome this, we introduce ``One-Shot Flow, Any-Time Frame," a novel framework for Event-based VFI (E-VFI) that achieves both high efficiency and superior quality for arbitrary-time interpolation. Our framework uniquely computes a comprehensive motion trajectory representation in a single pass using a Bidirectional Flow Estimation Block (BiFEB), leveraging the high temporal resolution of event data. Subsequently, our Flow Query (FQ) module can instantly retrieve the bidirectional optical flow for any timestamp, enabling the generation of any number of frames without repeated computation. Finally, a novel Bidirectional Warping (BiW) mechanism intelligently fuses the strengths of both warping directions, effectively mitigating artifacts and producing high-fidelity results. Extensive experiments show that our approach consistently surpasses state-of-the-art E-VFI methods in both reconstruction quality and inference efficiency, representing a substantial advance in efficient and high-quality event-based video interpolation. The code will be released after acceptance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c4d7aadb-8a70-48ae-b403-aac13c251f2dBuilds on24
- Channel Attention Is All You Need for Video Frame InterpolationMyungsub Choi, Heewon Kim, Bohyung Han, Ning Xu et al.AAAI 2020 · 362 citations
- IFRNet: Intermediate Feature Refine Network for Efficient Frame InterpolationLingtong Kong, Boyuan Jiang, Donghao Luo, Wenqing Chu et al.CVPR 2022 · 166 citations
- Video Frame Interpolation via Deformable Separable ConvolutionXianhang Cheng, Zhenzhong ChenAAAI 2020 · 153 citations
- Time Lens++: Event-based Frame Interpolation with Parametric Nonlinear Flow and Multi-scale FusionStepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis et al.CVPR 2022 · 126 citations
- Video Frame Interpolation TransformerZhihao Shi, Xiangyu Xu, Xiaohong Liu, Jun Chen et al.CVPR 2022 · 117 citations
Related papers
- Event-based Video Frame Interpolation with Cross-Modal Asymmetric Bidirectional Motion FieldsTaewoo Kim, Yujeong Chae, Hyun-Kurl Jang, Kuk-Jin YoonCVPR 2023
- Video Frame Interpolation via Direct Synthesis with the Event-based ReferenceYuhan Liu, Yongjian Deng, Hao Chen, Zhen YangCVPR 2024
- TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear MotionHaoyue Liu, Jinghan Xu, Yi Chang, Hanyu Zhou et al.CVPR 2025
- Event-Based Frame Interpolation with Ad-hoc DeblurringLei Sun, Christos Sakaridis, Jingyun Liang, Peng Sun et al.CVPR 2023
- Many-to-many Splatting for Efficient Video Frame InterpolationPing Hu, Simon Niklaus, Stan Sclaroff, Kate SaenkoCVPR 2022 · 63 citations
