Codebook-Empowered Analysis-Friendly Extreme Underwater Image Compression
Jianhao Wu, Yudong Mao, Qiuping Jiang
摘要
While existing underwater image compression (UIC) methods optimize for human perception or basic redundancies, they neglect inter-image correlations and fail to prioritize machine-friendly features essential for automated analysis. This paper introduces a novel vector-quantized (VQ) codebook-driven framework for machine-centric UIC. We leverage VQ codebooks -pre-trained as external priors on diverse underwater data -to unify three critical stages: (1) Machine-friendly feature extraction via contrastive learning with high/low-quality codebooks, enhancing degradation robustness; (2) Compact compression using variable-size codebooks to map discriminative features to entropy-coded indices, enabling ultra-low bitrates (less than 0.04bpp); and
(3) Feature refinement at the decoder, restoring semantic fidelity for downstream tasks. In addition, we contribute the first Underwater Visual Question Answering (UVQA) benchmark to holistically evaluate machine perception across object presence, counting, and localization. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art codecs in machine vision task performance at ultra-low bitrates. The VQ-codebook effectively harnesses inter-image redundancy, combats joint degradation, and delivers compact, analysis-friendly representations, establishing a new paradigm for machine-centric UIC.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive CodingDailan He, Ziming Yang, Weikun Peng, Rui Ma 等CVPR 2022 · 被引用 363 次
- The Devil Is in the Details: Window-based Attention for Image CompressionRenjie Zou, Chunfeng Song, Zhaoxiang ZhangCVPR 2022 · 被引用 260 次
- Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized NetworksMinyoung Huh, Brian Cheung, Pulkit Agrawal, Phillip IsolaICML 2023 · 被引用 104 次
- Adverse Weather Removal with Codebook PriorsTian Ye, Sixiang Chen, Jinbin Bai, Jun Shi 等ICCV 2023 · 被引用 64 次
相关 Paper
- UVEB: A Large-scale Benchmark and Baseline Towards Real-World Underwater Video EnhancementYaofeng Xie, Lingwei Kong, Kai Chen, Ziqiang Zheng 等CVPR 2024 · 被引用 20 次
- UQ-Bench: A Benchmark for Evaluating Multimodal LLMs on Underwater Image Quality AssessmentJingchao Cao, Guo An, Feng Gao, Ke Gu 等AAAI 2026
- RFD-ECNet: Extreme Underwater Image Compression with Reference to Feature DictionaryMengyao Li, Liquan Shen, Peng Ye, Guorui Feng 等ICCV 2023 · 被引用 11 次
- Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image CompressionShiyin Jiang, Wei Long, Minghao Han, Zhenghao Chen 等CVPR 2026 · 被引用 3 次
- Underwater Ranker: Learn Which Is Better and How to Be BetterChunle Guo, Ruiqi Wu, Xin Jin, Linghao Han 等AAAI 2023 · 被引用 224 次
