Hierarchical Frequency-Guided Alignment Transformer for Compressed Video Quality Enhancement
Liuhan Peng, Shuai Li, Yanbo Gao, Mao Ye, Chong Lv
Abstract
During the video encoding process, the original spatial domain signal is first transformed into the frequency domain, followed by quantization and compression. As a result, the quality degradation in compressed videos primarily stems from distortions in the frequency domain information. However, existing video enhancement methods typically directly fuse information from adjacent frames in the spatial domain, making it difficult for models to effectively compensate for frequency domain distortions, which leads to suboptimal detail restoration. To address this issue, we propose a Hierarchical Frequency-Guided Alignment Transformer. Additionally, by analyzing the characteristics of the frequency domain, we find that different frequency bands exhibit both correlations and a certain degree of independence. Based on this, we introduce a Frequency-Aware Transformer module that employs a combination of independent and mixed processing to optimize information exchange across different frequency domains, effectively mitigating cross-interference from irrelevant information. Experimental results demonstrate that, compared to existing methods, our approach achieves state-of-the-art performance in objective metrics (PSNR/SSIM), perceptual quality (LPIPS), and subjective visual effects, while reducing model complexity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou et al.CVPR 2022 · 1,970 citations
- Spatio-Temporal Deformable Convolution for Compressed Video Quality EnhancementJianing Deng, Li Wang, Shiliang Pu, Cheng ZhuoAAAI 2020 · 168 citations
- Recursive Fusion and Deformable Spatiotemporal Attention for Video Compression Artifact ReductionMinyi Zhao, Yi Xu, Shuigeng ZhouACM MM 2021 · 61 citations
- Video Compression Artifact Reduction by Fusing Motion Compensation and Global Context in a Swin-CNN Based Parallel ArchitectureXinjian Zhang, Su Yang, Wuyang Luo, Longwen Gao et al.AAAI 2023 · 15 citations
- CPGA: Coding Priors-Guided Aggregation Network for Compressed Video Quality EnhancementQiang Zhu, Jinhua Hao, Yukang Ding, Yu Liu et al.CVPR 2024 · 13 citations
Related papers
- Frequency-Aware Spatiotemporal Transformers for Video Inpainting DetectionBingyao Yu, Wanhua Li, Xiu Li, Jiwen Lu et al.ICCV 2021 · 38 citations
- Exploring Temporal Frequency Spectrum in Deep Video DeblurringQi Zhu, Man Zhou, Naishan Zheng, Chongyi Li et al.ICCV 2023 · 21 citations
- Rethinking Diffusion Model-Based Video Super-Resolution: Leveraging Dense Guidance from Aligned FeaturesJingyi Xu, Meisong Zheng, Ying Chen, Minglang Qiao et al.CVPR 2026 · 1 citation
- DreamUHD: Frequency Enhanced Variational Autoencoder for Ultra-High-Definition Image RestorationYidi Liu, Dong Li, Jie Xiao, Yuanfei Bao et al.AAAI 2025 · 11 citations
- Video Frame Interpolation TransformerZhihao Shi, Xiangyu Xu, Xiaohong Liu, Jun Chen et al.CVPR 2022 · 117 citations
