Zero-Shot Noise2Noise: Efficient Image Denoising without any Data
Youssef Mansour, Reinhard Heckel
Abstract
Recently, self-supervised neural networks have shown excellent image denoising performance. However, current dataset free methods are either computationally expensive, require a noise model, or have inadequate image quality. In this work we show that a simple 2layer network, without any training data or knowledge of the noise distribution, can enable high-quality image denoising at low computational cost. Our approach is motivated by Noise2Noise and Neighbor2Neighbor and works well for denoising pixel-wise independent noise. Our experiments on artificial, real-world camera, and microscope noise show that our method termed ZS-N2N (Zero Shot Noise2Noise) often outperforms existing dataset-free methods at a reduced cost, making it suitable for use cases with scarce data availability and limited computational resources. A demo of our implementation including our code and hyperparameters can be found in the following colab notebook.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3f2fca2-57b4-4a81-8d48-d045c3c7839eCited by top-tier papers24
- ZERO-IG: Zero-Shot Illumination-Guided Joint Denoising and Adaptive Enhancement for Low-Light ImagesYiqi Shi, Duo Liu, Liguo Zhang, Ye Tian et al.CVPR 2024 · 65 citations
- LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake DetectionDat Nguyen, Nesryne Mejri, Inder Pal Singh, Polina Kuleshova et al.CVPR 2024 · 47 citations
- DreamClean: Restoring Clean Image Using Deep Diffusion PriorJie Xiao, Ruili Feng, Han Zhang, Zhiheng Liu et al.ICLR 2024 · 23 citations
- Analyzing the Sample Complexity of Self-Supervised Image Reconstruction MethodsTobit Klug, Dogukan Atik, Reinhard HeckelNeurIPS 2023 · 13 citations
- Masked Pre-training Enables Universal Zero-shot DenoiserXiaoxiao Ma, Zhixiang Wei, Yi Jin, Pengyang Ling et al.NeurIPS 2024 · 11 citations
Builds on8
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- MAXIM: Multi-Axis MLP for Image ProcessingZhengzhong Tu, Hossein Talebi, Han Zhang, Feng Yang et al.CVPR 2022 · 550 citations
- Fully Convolutional Pixel Adaptive Image DenoiserSungmin Cha, Taesup MoonICCV 2019 · 56 citations
- CycleISP: Real Image Restoration via Improved Data SynthesisSyed Waqas Zamir, Aditya Arora, Salman H. Khan, Munawar Hayat et al.CVPR 2020
- Neighbor2Neighbor: Self-Supervised Denoising From Single Noisy ImagesTao Huang, Songjiang Li, Xu Jia, Huchuan Lu et al.CVPR 2021
Related papers
- Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot NetworkYeong Il Jang, Keuntek Lee, Gu Yong Park, Seyun Kim et al.ICCV 2023 · 29 citations
- Iterative Denoiser and Noise Estimator for Self-Supervised Image DenoisingYunhao Zou, Chenggang Yan, Ying FuICCV 2023 · 30 citations
- Convexity-Aware Noise Calibration: A Self-Supervised Framework for Noise-Level-Unknown Image DenoisingZhan Wang, Leiquan Wang, Chunlei Wu, Yu MengCVPR 2026
- Self2Self With Dropout: Learning Self-Supervised Denoising From Single ImageYuhui Quan, Mingqin Chen, Tongyao Pang, Hui JiCVPR 2020
- Noise2Same: Optimizing A Self-Supervised Bound for Image DenoisingYaochen Xie, Zhengyang Wang, Shuiwang JiNeurIPS 2020 · 135 citations
