On the Posterior Distribution in Denoising: Application to Uncertainty Quantification
Hila Manor, Tomer Michaeli
摘要
Denoisers play a central role in many applications, from noise suppression in low-grade imaging sensors, to empowering score-based generative models. The latter category of methods makes use of Tweedie's formula, which links the posterior mean in Gaussian denoising (the minimum MSE denoiser) with the score of the data distribution. Here, we derive a fundamental relation between the higher-order central moments of the posterior distribution, and the higher-order derivatives of the posterior mean. We harness this result for uncertainty quantification of pre-trained denoisers. Particularly, we show how to efficiently compute the principal components of the posterior distribution for any desired region of an image, as well as to approximate the full marginal distribution along those (or any other) one-dimensional directions. Our method is fast and memory-efficient, as it does not explicitly compute or store the high-order moment tensors and it requires no training or fine tuning of the denoiser. Code and examples are available on the project webpage in https://hilamanor.github.io/GaussianDenoisingPosterior/ .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper15
- Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM InversionHila Manor, Tomer MichaeliICML 2024 · 被引用 61 次
- Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian StructureXiang Li, Yixiang Dai, Qing QuNeurIPS 2024 · 被引用 45 次
- Exploring Low-Dimensional Subspace in Diffusion Models for Controllable Image EditingSiyi Chen, Huijie Zhang, Minzhe Guo, Yifu Lu 等NeurIPS 2024 · 被引用 29 次
- Uncertainty Quantification via Neural Posterior Principal ComponentsElias Nehme, Omer Yair, Tomer MichaeliNeurIPS 2023 · 被引用 25 次
- Towards Understanding the Mechanisms of Classifier-Free GuidanceXiang Li, Rongrong Wang, Qing QuNeurIPS 2025 · 被引用 14 次
它引用的顶会 Paper11
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine 等NeurIPS 2020 · 被引用 2,345 次
- Label-Efficient Semantic Segmentation with Diffusion ModelsDmitry Baranchuk, Andrey Voynov, Ivan Rubachev, Valentin Khrulkov 等ICLR 2022 · 被引用 700 次
- GENIE: Higher-Order Denoising Diffusion SolversTim Dockhorn, Arash Vahdat, Karsten KreisNeurIPS 2022 · 被引用 161 次
- Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in ImagingAnastasios N. Angelopoulos, Amit Pal Singh Kohli, Stephen Bates, Michael I. Jordan 等ICML 2022 · 被引用 115 次
相关 Paper
- Estimating High Order Gradients of the Data Distribution by DenoisingChenlin Meng, Yang Song, Wenzhe Li, Stefano ErmonNeurIPS 2021 · 被引用 85 次
- Noise Distribution Adaptive Self-Supervised Image Denoising using Tweedie Distribution and Score MatchingKwanyoung Kim, Taesung Kwon, Jong Chul YeCVPR 2022
- Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean ImagesKwanyoung Kim, Jong Chul YeNeurIPS 2021 · 被引用 176 次
- Noise2Score3D: Tweedie's Approach for Unsupervised Point Cloud DenoisingXiangbin Wei, Yuanfeng Wang, Ao Xu, Lingyu Zhu 等ICCV 2025 · 被引用 2 次
- Free Hunch: Denoiser Covariance Estimation for Diffusion Models Without Extra CostsSeveri Rissanen, Markus Heinonen, Arno SolinICLR 2025
