Compress Clean Signal from Noisy Raw Image: A Self-Supervised Approach
Zhihao Li, Yufei Wang, Alex C. Kot, Bihan Wen
Abstract
Raw images offer unique advantages in many lowlevel visual tasks due to their unprocessed nature. However, this unprocessed state accentuates noise, making raw images challenging to compress effectively. Current compression methods often overlook the ubiquitous noise in raw space, leading to increased bitrates and reduced quality. In this paper, we propose a novel raw image compression scheme that selectively compresses the noise-free component of the input, while discarding its real noise using a self-supervised approach. By excluding noise from the bitstream, both the coding efficiency and reconstruction quality are significantly enhanced. We curate a full-day dataset of raw images with calibrated noise parameters and reference images to evaluate the performance of models under a wide range of input signalnoise ratios. Experimental results demonstrate that our method surpasses existing compression techniques, achieving a more advantageous ratedistortion balance with improvements ranging from +2 to +10dB and yielding a bit saving of 2 to 50 times. The code is available at https: //lizhihao6.github.io/Cleans .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 576a9495-0d93-4ae0-9d70-481eec068b09Cited by top-tier papers1
Ask how each one uses itBuilds on7
- Low-Light Image Enhancement with Normalizing FlowYufei Wang, Renjie Wan, Wenhan Yang, Haoliang Li et al.AAAI 2022 · 548 citations
- ExposureDiffusion: Learning to Expose for Low-light Image EnhancementYufei Wang, Yi Yu, Wenhan Yang, Lanqing Guo et al.ICCV 2023 · 75 citations
- Learnability Enhancement for Low-light Raw Denoising: Where Paired Real Data Meets Noise ModelingHansen Feng, Lizhi Wang, Yuzhi Wang, Hua HuangACM MM 2022 · 36 citations
- Neighbor2Neighbor: Self-Supervised Denoising From Single Noisy ImagesTao Huang, Songjiang Li, Xu Jia, Huchuan Lu et al.CVPR 2021
- A Physics-Based Noise Formation Model for Extreme Low-Light Raw DenoisingKaixuan Wei, Ying Fu, Jiaolong Yang, Hua HuangCVPR 2020
Related papers
- Raw Image Reconstruction with Learned Compact MetadataYufei Wang, Yi Yu, Wenhan Yang, Lanqing Guo et al.CVPR 2023
- IDR: Self-Supervised Image Denoising via Iterative Data RefinementYi Zhang, Dasong Li, Ka Lung Law, Xiaogang Wang et al.CVPR 2022 · 70 citations
- From Chaos to Clarity: 3DGS in the DarkZhihao Li, Yufei Wang, Alex C. Kot, Bihan WenNeurIPS 2024 · 20 citations
- Rethinking Noise Synthesis and Modeling in Raw DenoisingYi Zhang, Hongwei Qin, Xiaogang Wang, Hongsheng LiICCV 2021 · 100 citations
- Prior Metadata-Driven RAW Reconstruction: Eliminating the Need for Per-Image MetadataWencheng Han, Chen Zhang, Yang Zhou, Wentao Liu et al.ACM MM 2024
