Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution
Xiaoyu Xiang, Yapeng Tian, Yulun Zhang, Yun Fu, Jan P. Allebach, Chenliang Xu
Abstract
Overlayed LR inputs HR intermediate frame Overlayed LR inputs DAIN+Bicubic DAIN+EDVR Ours Figure 1: Example of space-time video super-resolution. We propose a one-stage space-time video super-resolution (STVSR) network to directly predict high frame rate (HFR) and high-resolution (HR) frames from the corresponding lowresolution (LR) and low frame rate (LFR) frames without explicitly interpolating intermediate LR frames. A HR intermediate frame t and its neighboring low-resolution frames: t -1 and t + 1 as an overlayed image are shown. Compare to a state-ofthe-art two-stage method: DAIN [1]+EDVR [37] on the HR intermediate frame t, our method is more capable of handling visual motions and therefore restores more accurate image structures and sharper edges. In addition, our network is more than 3 times faster on inference speed with a 4 times smaller model size than the DAIN+EDVR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 46105e5b-f936-4e28-9cd5-4695a4869906Cited by top-tier papers41
- BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and AlignmentKelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu, Chen Change LoyCVPR 2022 · 522 citations
- Recurrent Video Restoration Transformer with Guided Deformable AttentionJingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan et al.NeurIPS 2022 · 318 citations
- XVFI: eXtreme Video Frame InterpolationHyeonjun Sim, Jihyong Oh, Munchurl KimICCV 2021 · 207 citations
- Towards An End-to-End Framework for Flow-Guided Video InpaintingZhen Li, Chengze Lu, Jianhua Qin, Chun-Le Guo et al.CVPR 2022 · 136 citations
- Video Frame Interpolation with TransformerLiying Lu, Ruizheng Wu, Huaijia Lin, Jiangbo Lu et al.CVPR 2022 · 128 citations
Related papers
- RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-ResolutionZhicheng Geng, Luming Liang, Tianyu Ding, Ilya ZharkovCVPR 2022 · 103 citations
- How Video Super-Resolution and Frame Interpolation Mutually BenefitChengcheng Zhou, Zongqing Lu, Linge Li, Qiangyu Yan et al.ACM MM 2021 · 12 citations
- Space-Time-Aware Multi-Resolution Video EnhancementMuhammad Haris, Greg Shakhnarovich, Norimichi UkitaCVPR 2020
- Temporal Modulation Network for Controllable Space-Time Video Super-ResolutionGang Xu, Jun Xu, Zhen Li, Liang Wang et al.CVPR 2021
- Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual LearningMengshun Hu, Kui Jiang, Liang Liao, Jing Xiao et al.CVPR 2022 · 37 citations
