CLG-INet: Coupled Local-Global Interactive Network for Image Restoration
Yuqi Jiang, Chune Zhang, Shuo Jin, Jiao Liu, Jiapeng Wang
Abstract
Image restoration is an ill-posed problem due to the infinite feasible solutions for degraded images. Although CNN-based and Transformer-based approaches have been proven effective in image restoration, there are still two challenges in restoring complex degraded images: 1)local-global information extraction and fusion, and 2)computational cost overhead. To address these challenges, in this paper, we propose a lightweight image restoration network (CLG-INet) based on CNN-Transformer interaction, which can efficiently couple the local and global information. Specifically, our model is hierarchically built with a "sandwich-like" structure of coupling blocks, where each block contains three layers in sequence (CNN-Transformer-CNN). The Transformer layer is designed with two core modules: Dynamic Bi-Projected Attention (DBPA), which performs dual projection with large convolutions across windows to capture long-range dependencies, and Gated Non-linear Feed-Forward Network (GNFF), which reconstructs mixed feature information. In addition, we introduce interactive learning, which fuses local features and global representations in different resolutions to the maximum extent. Extensive experiments demonstrate that CLG-INet significantly boosts performance on various image restoration tasks, such as deraining, deblurring, and denoising.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 222d6f40-102e-41a9-ac7d-457c16655ec3Related papers
- Hybrid CNN-Transformer Feature Fusion for Single Image DerainingXiang Chen, Jinshan Pan, Jiyang Lu, Zhentao Fan et al.AAAI 2023 · 75 citations
- Compacter: A Lightweight Transformer for Image RestorationZhijian Wu, Jun Li, Yang Hu, Dingjiang HuangACM MM 2024
- Magic ELF: Image Deraining Meets Association Learning and TransformerKui Jiang, Zhongyuan Wang, Chen Chen, Zheng Wang et al.ACM MM 2022 · 99 citations
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- IRNeXt: Rethinking Convolutional Network Design for Image RestorationYuning Cui, Wenqi Ren, Sining Yang, Xiaochun Cao et al.ICML 2023 · 112 citations
