Prompt-Guided Alignment with Information Bottleneck Makes Image Compression Also a Restorer
Xuelin Shen, Quan Liu, Jiayin Xu, Wenhan Yang
摘要
Learned Image Compression (LIC) models face critical challenges in real-world scenarios due to various environmental degradations, such as fog and rain. Due to the distribution mismatch between degraded inputs and clean training data, well-trained LIC models suffer from reduced compression efficiency, while retraining dedicated models for diverse degradation types is costly and impractical. Our method addresses the above issue by leveraging prompt learning under the information bottleneck principle, enabling compact extraction of shared components between degraded and clean images for improved latent alignment and compression efficiency. In detail, we propose an Information Bottleneck-constrained Latent Representation Unifying (IB-LRU) scheme, in which a Probabilistic Prompt Generator (PPG) is deployed to simultaneously capture the distribution of different degradations. Such a design dynamically guides the latent-representation process at the encoder through a gated modulation process. Moreover, to promote the degradation distribution capture process, the probabilistic prompt learning is guided by the Information Bottleneck (IB) principle. That is, IB constrains the information encoded in the prompt to focus solely on degradation characteristics while avoiding the inclusion of redundant image contextual information. We apply our IB-LRU method to a variety of state-of-the-art LIC backbones, and extensive experiments under various degradation scenarios demonstrate the effectiveness of our design. Code is available at https://github.com/liuquan0521-sys/IB-LRU-compression .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 被引用 1,438 次
- PromptIR: Prompting for All-in-One Image RestorationVaishnav Potlapalli, Syed Waqas Zamir, Salman H. Khan, Fahad Shahbaz KhanNeurIPS 2023 · 被引用 386 次
- All-In-One Image Restoration for Unknown CorruptionBoyun Li, Xiao Liu, Peng Hu, Zhongqin Wu 等CVPR 2022 · 被引用 338 次
- The Devil Is in the Details: Window-based Attention for Image CompressionRenjie Zou, Chunfeng Song, Zhaoxiang ZhangCVPR 2022 · 被引用 260 次
相关 Paper
- Learning Real-World Image De-weathering with Imperfect SupervisionXiaohui Liu, Zhilu Zhang, Xiaohe Wu, Chaoyu Feng 等AAAI 2024 · 被引用 6 次
- Is the Information Bottleneck Robust Enough? Towards Label-Noise Resistant Information Bottleneck LearningYi Huang, Qingyun Sun, Yisen Gao, Haonan Yuan 等AAAI 2026 · 被引用 2 次
- Dreaming to Prune Image Deraining NetworksWeiqi Zou, Yang Wang, Xueyang Fu, Yang CaoCVPR 2022 · 被引用 23 次
- PromptRestorer: A Prompting Image Restoration Method with Degradation PerceptionCong Wang, Jinshan Pan, Wei Wang, Jiangxin Dong 等NeurIPS 2023 · 被引用 109 次
- Balanced Rate-Distortion Optimization in Learned Image CompressionYichi Zhang, Zhihao Duan, Yuning Huang, Fengqing ZhuCVPR 2025
