Noise Distribution Adaptive Self-Supervised Image Denoising using Tweedie Distribution and Score Matching
Kwanyoung Kim, Taesung Kwon, Jong Chul Ye
Abstract
Tweedie distributions are a special case of exponential dispersion models, which are often used in classical statistics as distributions for generalized linear models. Here, we show that Tweedie distributions also play key roles in modern deep learning era, leading to a distribution adaptive self-supervised image denoising formula without clean reference images. Specifically, by combining with the recent Noise2Score self-supervised image denoising approach and the saddle point approximation of Tweedie distribution, we provide a general closed-form denoising formula that can be used for large classes of noise distributions without ever knowing the underlying noise distribution. Similar to the original Noise2Score, the new approach is composed of two successive steps: score matching using perturbed noisy images, followed by a closed form image denoising formula via distribution-independent Tweedie's formula. In addition, we reveal a systematic algorithm to estimate the noise model and noise parameters for a given noisy image data set. Through extensive experiments, we demonstrate that the proposed method can accurately estimate noise models and parameters, and provide the state-of-the-art self-supervised image denoising performance in the benchmark dataset and real-world dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55ca6e8b-435d-4f5d-8f50-235c33deb673Cited by top-tier papers8
- Image Restoration with Mean-Reverting Stochastic Differential EquationsZiwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund et al.ICML 2023 · 293 citations
- Masked Pre-training Enables Universal Zero-shot DenoiserXiaoxiao Ma, Zhixiang Wei, Yi Jin, Pengyang Ling et al.NeurIPS 2024 · 11 citations
- Pseudo-Siamese Blind-spot Transformers for Self-Supervised Real-World DenoisingYuhui Quan, Tianxiang Zheng, Hui JiNeurIPS 2024 · 5 citations
- Positive2Negative: Breaking the Information-Lossy Barrier in Self-Supervised Single Image DenoisingTong Li, Lizhi Wang, Zhiyuan Xu, Lin Zhu et al.CVPR 2025
- Generalized Recorrupted-to-Recorrupted: Self-Supervised Learning Beyond Gaussian NoiseBrayan Monroy, Jorge Bacca, Julián TachellaCVPR 2025
Builds on7
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean ImagesKwanyoung Kim, Jong Chul YeNeurIPS 2021 · 176 citations
- Noise2Same: Optimizing A Self-Supervised Bound for Image DenoisingYaochen Xie, Zhengyang Wang, Shuiwang JiNeurIPS 2020 · 135 citations
- AR-DAE: Towards Unbiased Neural Entropy Gradient EstimationJae Hyun Lim, Aaron C. Courville, Christopher J. Pal, Chin-Wei HuangICML 2020 · 26 citations
- Neighbor2Neighbor: Self-Supervised Denoising From Single Noisy ImagesTao Huang, Songjiang Li, Xu Jia, Huchuan Lu et al.CVPR 2021
Related papers
- Noise2Score3D: Tweedie's Approach for Unsupervised Point Cloud DenoisingXiangbin Wei, Yuanfeng Wang, Ao Xu, Lingyu Zhu et al.ICCV 2025 · 2 citations
- On the Posterior Distribution in Denoising: Application to Uncertainty QuantificationHila Manor, Tomer MichaeliICLR 2024 · 26 citations
- Convexity-Aware Noise Calibration: A Self-Supervised Framework for Noise-Level-Unknown Image DenoisingZhan Wang, Leiquan Wang, Chunlei Wu, Yu MengCVPR 2026
- Estimating High Order Gradients of the Data Distribution by DenoisingChenlin Meng, Yang Song, Wenzhe Li, Stefano ErmonNeurIPS 2021 · 85 citations
- Multi-view Self-supervised Disentanglement for General Image DenoisingHao Chen, Chenyuan Qu, Yu Zhang, Chen Chen et al.ICCV 2023 · 15 citations
