Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising
Jun Cheng, Tao Liu, Shan Tan
Abstract
Real-world single image denoising is crucial and practical in computer vision. Bayesian inversions combined with score priors now have proven effective for single image denoising but are limited to white Gaussian noise. Moreover, applying existing score-based methods for real-world denoising requires not only the explicit train of score priors on the target domain but also the careful design of sampling procedures for posterior inference, which is complicated and impractical. To address these limitations, we propose a score priors-guided deep variational inference, namely ScoreDVI, for practical real-world denoising. By considering the deep variational image posterior with a Gaussian form, score priors are extracted based on easily accessible minimum MSE Non-i.i.d Gaussian denoisers and variational samples, which in turn facilitate optimizing the variational image posterior. Such a procedure adaptively applies cheap score priors to denoising. Additionally, we exploit a Non-i.i.d Gaussian mixture model and variational noise posterior to model the real-world noise. This scheme also enables the pixel-wise fusion of multiple image priors and variational image posteriors. Besides, we develop a noise-aware prior assignment strategy that dynamically adjusts the weight of image priors in the optimization. Our method outperforms other single image-based real-world denoising methods and achieves comparable performance to dataset-based unsupervised methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language ModelsHaoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren et al.NeurIPS 2024 · 49 citations
- Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image DenoisingJunyi Li, Zhilu Zhang, Wangmeng ZuoAAAI 2025 · 31 citations
- Masked Pre-training Enables Universal Zero-shot DenoiserXiaoxiao Ma, Zhixiang Wei, Yi Jin, Pengyang Ling et al.NeurIPS 2024 · 11 citations
- SeNM-VAE: Semi-Supervised Noise Modeling with Hierarchical Variational AutoencoderDihan Zheng, Yihang Zou, Xiaowen Zhang, Chenglong BaoCVPR 2024 · 5 citations
- Pseudo-Siamese Blind-spot Transformers for Self-Supervised Real-World DenoisingYuhui Quan, Tianxiang Zheng, Hui JiNeurIPS 2024 · 5 citations
Builds on22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
Related papers
- Unsupervised Image Denoising with Score FunctionYutong Xie, Mingze Yuan, Bin Dong, Quanzheng LiNeurIPS 2023 · 13 citations
- Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean ImagesKwanyoung Kim, Jong Chul YeNeurIPS 2021 · 176 citations
- An Unsupervised Deep Learning Approach for Real-World Image DenoisingDihan Zheng, Sia Huat Tan, Xiaowen Zhang, Zuoqiang Shi et al.ICLR 2021 · 29 citations
- Stochastic Deep Restoration Priors for Imaging Inverse ProblemsYuyang Hu, Albert Peng, Weijie Gan, Peyman Milanfar et al.ICML 2025
- Stochastic Solutions for Linear Inverse Problems using the Prior Implicit in a DenoiserZahra Kadkhodaie, Eero P. SimoncelliNeurIPS 2021 · 202 citations
