IAFMNet: Information-Aware Feature Modulation for Efficient Super-Resolution
Junwei Xu, Mengzu Liu, Zhenyu Wang, Fangfang Wu, Sijia Wu, Tao Huang, Weisheng Dong
摘要
Single Image Super-Resolution (SISR) aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) input, a task that becomes increasingly challenging under real-world computational constraints. However, most efficient SISR methods adopt lightweight, spatially uniform strategies that allocate equal computation and attention across all regions, ignoring the uneven distribution of visual complexity. From an information-theoretic perspective, textures and edges inherently carry more critical information, resulting in reconstruction errors that are disproportionately concentrated in these regions. This motivates the allocation of greater computational resources and attention to these informative areas. In this paper, we propose IAFMNet, an Information-Aware Feature Modulation network for efficient SR. At its core lies the Information Density Map (IDM), which is estimated in an unsupervised manner by minimizing the Information Entropy Loss, thereby highlighting informative regions with high estimated encoding costs. Guided by the IDM, IAFMNet adopts a synergistic dual-branch design: (1) a sparse convolution branch that dynamically allocates computation to informative areas while bypassing low-information regions, and (2) an implicit modulation branch that adaptively emphasizes complex regions through information-aware affine transformations. Extensive experiments demonstrate that IAFMNet effectively identifies informative regions and achieves superior visual fidelity with reduced computational overhead.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-resolution and BeyondWenbo Li, Kun Zhou, Lu Qi, Nianjuan Jiang 等NeurIPS 2020 · 被引用 293 次
- Spatially-Adaptive Feature Modulation for Efficient Image Super-ResolutionLong Sun, Jiangxin Dong, Jinhui Tang, Jinshan PanICCV 2023 · 被引用 211 次
- ShuffleMixer: An Efficient ConvNet for Image Super-ResolutionLong Sun, Jinshan Pan, Jinhui TangNeurIPS 2022 · 被引用 177 次
- Uncertainty-Driven Loss for Single Image Super-ResolutionQian Ning, Weisheng Dong, Xin Li, Jinjian Wu 等NeurIPS 2021 · 被引用 113 次
- Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token DictionaryLeheng Zhang, Yawei Li, Xingyu Zhou, Xiaorui Zhao 等CVPR 2024 · 被引用 73 次
相关 Paper
- Learning Frequency-aware Dynamic Network for Efficient Super-ResolutionWenbin Xie, Dehua Song, Chang Xu, Chunjing Xu 等ICCV 2021 · 被引用 89 次
- Exploring Sparsity in Image Super-Resolution for Efficient InferenceLongguang Wang, Xiaoyu Dong, Yingqian Wang, Xinyi Ying 等CVPR 2021
- Information-Growth Attention Network for Image Super-ResolutionZhuangzi Li, Ge Li, Thomas H. Li, Shan Liu 等ACM MM 2021 · 被引用 41 次
- Efficient Single Image Super-Resolution with Entropy Attention and Receptive Field AugmentationXiaole Zhao, Linze Li, Chengxing Xie, Xiaoming Zhang 等ACM MM 2024 · 被引用 12 次
- Separable Modulation Network for Efficient Image Super-ResolutionZhijian Wu, Jun Li, Dingjiang HuangACM MM 2023 · 被引用 5 次
