Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment
Yixiao Li, Xiaoyuan Yang, Weide Liu, Xin Jin, Xu Jia, Yu-Kun Lai, Paul L. Rosin, Hantao Liu, Wei Zhou
摘要
As super-resolution (SR) techniques introduce unique distortions that fundamentally differ from those caused by traditional degradation processes (e.g., compression), there is an increasing demand for specialized video quality assessment (VQA) methods tailored to SR-generated content. One critical factor affecting perceived quality is temporal inconsistency, which refers to irregularities between consecutive frames. However, existing VQA approaches rarely quantify this phenomenon or explicitly investigate its relationship with human perception. Moreover, SR videos exhibit amplified inconsistency levels as a result of enhancement processes. In this paper, we propose Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment (TIG-SVQA) that underscores the critical role of temporal inconsistency in guiding the quality assessment of SR videos. We first design a perception-oriented approach to quantify frame-wise temporal inconsistency. Based on this, we introduce the Inconsistency Highlighted Spatial Module, which localizes inconsistent regions at both coarse and fine scales. Inspired by the human visual system, we further develop an Inconsistency Guided Temporal Module that performs progressive temporal feature aggregation: (1) a consistency-aware fusion stage in which a visual memory capacity block adaptively determines the information load of each temporal segment based on inconsistency levels, and (2) an informative filtering stage for emphasizing quality-related features. Extensive experiments on both single-frame and multi-frame SR video scenarios demonstrate that our method significantly outperforms state-of-the-art VQA approaches. The code is publicly available at https://github.com/Lighting-YXLI/TIG-SVQA-main .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu 等ICCV 2021 · 被引用 31,683 次
- BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and AlignmentKelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu, Chen Change LoyCVPR 2022 · 被引用 522 次
- A Deep Learning based No-reference Quality Assessment Model for UGC VideosWei Sun, Xiongkuo Min, Wei Lu, Guangtao ZhaiACM MM 2022 · 被引用 239 次
- Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality AssessmentHeliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha 等ICCV 2021 · 被引用 67 次
- Perceptual Quality Assessment of Internet VideosJiahua Xu, Jing Li, Xingguang Zhou, Wei Zhou 等ACM MM 2021 · 被引用 44 次
相关 Paper
- Bridging the Perception Gap in Image Super-Resolution EvaluationShaolin Su, Josep M. Rocafort, Danna Xue, David Serrano-Lozano 等CVPR 2026 · 被引用 4 次
- VideoGigaGAN: Towards Detail-rich Video Super-ResolutionYiran Xu, Taesung Park, Richard Zhang, Yang Zhou 等CVPR 2025
- Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical FidelityWei Zhou, Zhou WangACM MM 2022 · 被引用 38 次
- RIRNet: Recurrent-In-Recurrent Network for Video Quality AssessmentPengfei Chen, Leida Li, Lei Ma, Jinjian Wu 等ACM MM 2020 · 被引用 94 次
- Stereo Video Super-Resolution via Exploiting View-Temporal CorrelationsRuikang Xu, Zeyu Xiao, Mingde Yao, Yueyi Zhang 等ACM MM 2021 · 被引用 20 次
