On the Posterior Distribution in Denoising: Application to Uncertainty Quantification
Hila Manor, Tomer Michaeli
Abstract
Denoisers play a central role in many applications, from noise suppression in low-grade imaging sensors, to empowering score-based generative models. The latter category of methods makes use of Tweedie's formula, which links the posterior mean in Gaussian denoising (the minimum MSE denoiser) with the score of the data distribution. Here, we derive a fundamental relation between the higher-order central moments of the posterior distribution, and the higher-order derivatives of the posterior mean. We harness this result for uncertainty quantification of pre-trained denoisers. Particularly, we show how to efficiently compute the principal components of the posterior distribution for any desired region of an image, as well as to approximate the full marginal distribution along those (or any other) one-dimensional directions. Our method is fast and memory-efficient, as it does not explicitly compute or store the high-order moment tensors and it requires no training or fine tuning of the denoiser. Code and examples are available on the project webpage in https://hilamanor.github.io/GaussianDenoisingPosterior/ .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers15
- Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM InversionHila Manor, Tomer MichaeliICML 2024 · 61 citations
- Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian StructureXiang Li, Yixiang Dai, Qing QuNeurIPS 2024 · 45 citations
- Exploring Low-Dimensional Subspace in Diffusion Models for Controllable Image EditingSiyi Chen, Huijie Zhang, Minzhe Guo, Yifu Lu et al.NeurIPS 2024 · 29 citations
- Uncertainty Quantification via Neural Posterior Principal ComponentsElias Nehme, Omer Yair, Tomer MichaeliNeurIPS 2023 · 25 citations
- Towards Understanding the Mechanisms of Classifier-Free GuidanceXiang Li, Rongrong Wang, Qing QuNeurIPS 2025 · 14 citations
Builds on11
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Label-Efficient Semantic Segmentation with Diffusion ModelsDmitry Baranchuk, Andrey Voynov, Ivan Rubachev, Valentin Khrulkov et al.ICLR 2022 · 700 citations
- GENIE: Higher-Order Denoising Diffusion SolversTim Dockhorn, Arash Vahdat, Karsten KreisNeurIPS 2022 · 161 citations
- Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in ImagingAnastasios N. Angelopoulos, Amit Pal Singh Kohli, Stephen Bates, Michael I. Jordan et al.ICML 2022 · 115 citations
Related papers
- Estimating High Order Gradients of the Data Distribution by DenoisingChenlin Meng, Yang Song, Wenzhe Li, Stefano ErmonNeurIPS 2021 · 85 citations
- Noise Distribution Adaptive Self-Supervised Image Denoising using Tweedie Distribution and Score MatchingKwanyoung Kim, Taesung Kwon, Jong Chul YeCVPR 2022
- Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean ImagesKwanyoung Kim, Jong Chul YeNeurIPS 2021 · 176 citations
- Noise2Score3D: Tweedie's Approach for Unsupervised Point Cloud DenoisingXiangbin Wei, Yuanfeng Wang, Ao Xu, Lingyu Zhu et al.ICCV 2025 · 2 citations
- Free Hunch: Denoiser Covariance Estimation for Diffusion Models Without Extra CostsSeveri Rissanen, Markus Heinonen, Arno SolinICLR 2025
