Surface-Aware Feed-Forward Quadratic Gaussian for Frame Interpolation with Large Motion
Zaoming Yan, Yaomin Huang, Pengcheng Lei, Qizhou Chen, Guixu Zhang, Faming Fang
Abstract
Large motion poses a critical challenge in Video Frame Interpolation (VFI) task, as it requires accurate modeling of object correspondences across frames. Existing methods primarily rely on convolutional or attention-based models, which operate at the pixel or patch level. This inherently limits them to local object correspondences, making it difficult to capture frame-level object correspondences and often leading to failure under large motion. Inspired by the fundamental theorem of surface, we explore frame-level object correspondences through the lens of differential surface. The core idea is to represent video frames as 3D surfaces and align them by matching their surface properties, thereby achieving global surface alignment and frame-level object alignment. To implement the core idea, we propose the Surface-Aware Feed-Forward Quadratic Gaussian framework, mainly consisting of the Feed-Forward Quadratic Gaussian and Surface Properties modules. Feed-Forward Quadratic Gaussian is designed to map frames to Quadratic Gaussian, which flexibly fits the object surface. Unlike previous methods that compute lo-cal correspondences, Surface Properties facilitates global surface-level alignment, which drives object correspondence alignment. Finally, we rasterize the surface properties onto the interpolated camera plane and define loss functions to supervise alignment explicitly. The outstanding performance on the large motion benchmark demonstrates the effectiveness of our framework.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 92664b1d-600c-42dd-98bd-b8cc622ee9d6Builds on49
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie et al.CVPR 2024 · 513 citations
- Channel Attention Is All You Need for Video Frame InterpolationMyungsub Choi, Heewon Kim, Bohyung Han, Ning Xu et al.AAAI 2020 · 362 citations
Related papers
- Sparse Global Matching for Video Frame Interpolation with Large MotionChunxu Liu, Guozhen Zhang, Rui Zhao, Limin WangCVPR 2024 · 17 citations
- Video Frame Interpolation with TransformerLiying Lu, Ruizheng Wu, Huaijia Lin, Jiangbo Lu et al.CVPR 2022 · 128 citations
- Explicit Depth-Aware Blurry Video Frame Interpolation Guided by Differential CurvesZaoming Yan, Pengcheng Lei, Tingting Wang, Faming Fang et al.CVPR 2025
- D-FCGS: Feedforward Compression of Dynamic Gaussian Splatting for Free-Viewpoint VideosWenkang Zhang, Yan Zhao, Qiang Wang, Zhixin Xu et al.AAAI 2026 · 1 citation
- Long-term Video Frame Interpolation via Feature PropagationDawit Mureja Argaw, In So KweonCVPR 2022 · 12 citations
