IAFMNet: Information-Aware Feature Modulation for Efficient Super-Resolution
Junwei Xu, Mengzu Liu, Zhenyu Wang, Fangfang Wu, Sijia Wu, Tao Huang, Weisheng Dong
Abstract
Single Image Super-Resolution (SISR) aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) input, a task that becomes increasingly challenging under real-world computational constraints. However, most efficient SISR methods adopt lightweight, spatially uniform strategies that allocate equal computation and attention across all regions, ignoring the uneven distribution of visual complexity. From an information-theoretic perspective, textures and edges inherently carry more critical information, resulting in reconstruction errors that are disproportionately concentrated in these regions. This motivates the allocation of greater computational resources and attention to these informative areas. In this paper, we propose IAFMNet, an Information-Aware Feature Modulation network for efficient SR. At its core lies the Information Density Map (IDM), which is estimated in an unsupervised manner by minimizing the Information Entropy Loss, thereby highlighting informative regions with high estimated encoding costs. Guided by the IDM, IAFMNet adopts a synergistic dual-branch design: (1) a sparse convolution branch that dynamically allocates computation to informative areas while bypassing low-information regions, and (2) an implicit modulation branch that adaptively emphasizes complex regions through information-aware affine transformations. Extensive experiments demonstrate that IAFMNet effectively identifies informative regions and achieves superior visual fidelity with reduced computational overhead.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6f72441d-59e4-4e7a-8430-43a52f944666Builds on16
- LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-resolution and BeyondWenbo Li, Kun Zhou, Lu Qi, Nianjuan Jiang et al.NeurIPS 2020 · 293 citations
- Spatially-Adaptive Feature Modulation for Efficient Image Super-ResolutionLong Sun, Jiangxin Dong, Jinhui Tang, Jinshan PanICCV 2023 · 211 citations
- ShuffleMixer: An Efficient ConvNet for Image Super-ResolutionLong Sun, Jinshan Pan, Jinhui TangNeurIPS 2022 · 177 citations
- Uncertainty-Driven Loss for Single Image Super-ResolutionQian Ning, Weisheng Dong, Xin Li, Jinjian Wu et al.NeurIPS 2021 · 113 citations
- Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token DictionaryLeheng Zhang, Yawei Li, Xingyu Zhou, Xiaorui Zhao et al.CVPR 2024 · 73 citations
Related papers
- Learning Frequency-aware Dynamic Network for Efficient Super-ResolutionWenbin Xie, Dehua Song, Chang Xu, Chunjing Xu et al.ICCV 2021 · 89 citations
- Exploring Sparsity in Image Super-Resolution for Efficient InferenceLongguang Wang, Xiaoyu Dong, Yingqian Wang, Xinyi Ying et al.CVPR 2021
- Information-Growth Attention Network for Image Super-ResolutionZhuangzi Li, Ge Li, Thomas H. Li, Shan Liu et al.ACM MM 2021 · 41 citations
- Efficient Single Image Super-Resolution with Entropy Attention and Receptive Field AugmentationXiaole Zhao, Linze Li, Chengxing Xie, Xiaoming Zhang et al.ACM MM 2024 · 12 citations
- Separable Modulation Network for Efficient Image Super-ResolutionZhijian Wu, Jun Li, Dingjiang HuangACM MM 2023 · 5 citations
