Codebook-Empowered Analysis-Friendly Extreme Underwater Image Compression
Jianhao Wu, Yudong Mao, Qiuping Jiang
Abstract
While existing underwater image compression (UIC) methods optimize for human perception or basic redundancies, they neglect inter-image correlations and fail to prioritize machine-friendly features essential for automated analysis. This paper introduces a novel vector-quantized (VQ) codebook-driven framework for machine-centric UIC. We leverage VQ codebooks -pre-trained as external priors on diverse underwater data -to unify three critical stages: (1) Machine-friendly feature extraction via contrastive learning with high/low-quality codebooks, enhancing degradation robustness; (2) Compact compression using variable-size codebooks to map discriminative features to entropy-coded indices, enabling ultra-low bitrates (less than 0.04bpp); and
(3) Feature refinement at the decoder, restoring semantic fidelity for downstream tasks. In addition, we contribute the first Underwater Visual Question Answering (UVQA) benchmark to holistically evaluate machine perception across object presence, counting, and localization. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art codecs in machine vision task performance at ultra-low bitrates. The VQ-codebook effectively harnesses inter-image redundancy, combats joint degradation, and delivers compact, analysis-friendly representations, establishing a new paradigm for machine-centric UIC.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 99d21ec4-195b-4895-aef5-51a3a321edd8Builds on9
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive CodingDailan He, Ziming Yang, Weikun Peng, Rui Ma et al.CVPR 2022 · 363 citations
- The Devil Is in the Details: Window-based Attention for Image CompressionRenjie Zou, Chunfeng Song, Zhaoxiang ZhangCVPR 2022 · 260 citations
- Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized NetworksMinyoung Huh, Brian Cheung, Pulkit Agrawal, Phillip IsolaICML 2023 · 104 citations
- Adverse Weather Removal with Codebook PriorsTian Ye, Sixiang Chen, Jinbin Bai, Jun Shi et al.ICCV 2023 · 64 citations
Related papers
- UVEB: A Large-scale Benchmark and Baseline Towards Real-World Underwater Video EnhancementYaofeng Xie, Lingwei Kong, Kai Chen, Ziqiang Zheng et al.CVPR 2024 · 20 citations
- UQ-Bench: A Benchmark for Evaluating Multimodal LLMs on Underwater Image Quality AssessmentJingchao Cao, Guo An, Feng Gao, Ke Gu et al.AAAI 2026
- RFD-ECNet: Extreme Underwater Image Compression with Reference to Feature DictionaryMengyao Li, Liquan Shen, Peng Ye, Guorui Feng et al.ICCV 2023 · 11 citations
- Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image CompressionShiyin Jiang, Wei Long, Minghao Han, Zhenghao Chen et al.CVPR 2026 · 3 citations
- Underwater Ranker: Learn Which Is Better and How to Be BetterChunle Guo, Ruiqi Wu, Xin Jin, Linghao Han et al.AAAI 2023 · 224 citations
