LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning
Jiang Yuan, Ji Ma, Bo Wang, Guanzhou Ke, Weiming Hu
Abstract
Implicit degradation estimation-based blind super-resolution (IDE-BSR) hinges on extracting the implicit degradation representation (IDR) of the LR image and adapting it to LR image features to guide HR detail restoration. Although IDE-BSR has shown potential in dealing with noise interference and complex degradations, existing methods ignore the importance of IDR discriminability for BSR and instead over-complicate the adaptation process to improve effect, resulting in a significant increase in the model's parameters and computations. In this paper, we focus on the discriminability optimization of IDR and propose a new powerful and lightweight BSR model termed LightBSR. Specifically, we employ a knowledge distillation-based learning framework. We first introduce a well-designed degradation-prior-constrained contrastive learning technique during teacher stage to make the model more focused on distinguishing different degradation types. Then we utilize a feature alignment technique to transfer the degradation-related knowledge acquired by the teacher to the student for practical inferencing. Extensive experiments demonstrate the effectiveness of IDR discriminability-driven BSR model design. The proposed LightBSR can achieve outstanding performance with minimal complexity across a range of blind SR tasks. Our code is accessible at: https://github.com/MJ-NCEPU/LightBSR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4e9cc85d-47b0-49b8-9ef0-7e7623a83089Cited by top-tier papers1
Ask how each one uses itBuilds on15
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer et al.CVPR 2022 · 6,782 citations
- Designing a Practical Degradation Model for Deep Blind Image Super-ResolutionKai Zhang, Jingyun Liang, Luc Van Gool, Radu TimofteICCV 2021 · 898 citations
- Unfolding the Alternating Optimization for Blind Super ResolutionZhengxiong Luo, Yan Huang, Shang Li, Liang Wang et al.NeurIPS 2020 · 348 citations
- Dual Aggregation Transformer for Image Super-ResolutionZheng Chen, Yulun Zhang, Jinjin Gu, Linghe Kong et al.ICCV 2023 · 345 citations
Related papers
- Knowledge Distillation based Degradation Estimation for Blind Super-ResolutionBin Xia, Yulun Zhang, Yitong Wang, Yapeng Tian et al.ICLR 2023 · 9 citations
- Unsupervised Degradation Representation Learning for Blind Super-ResolutionLongguang Wang, Yingqian Wang, Xiaoyu Dong, Qingyu Xu et al.CVPR 2021
- CDFormer: When Degradation Prediction Embraces Diffusion Model for Blind Image Super-ResolutionQingguo Liu, Chenyi Zhuang, Pan Gao, Jie QinCVPR 2024 · 19 citations
- Unsupervised Degradation Representation Aware Transform for Real-World Blind Image Super-ResolutionSen Chen, Hongying Liu, Chaowei Fang, Fanhua Shang et al.AAAI 2025 · 1 citation
- Joint Learning Content and Degradation Aware Feature for Blind Super-ResolutionYifeng Zhou, Chuming Lin, Donghao Luo, Yong Liu et al.ACM MM 2022 · 14 citations
