Uncertainty Visualization via Low-Dimensional Posterior Projections
Omer Yair, Elias Nehme, Tomer Michaeli
Abstract
In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible so-lutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is encoded in the posterior distribution. However, for high-dimensional data, this distribution is challenging to visualize. In this work, we introduce a new approach for estimating and visualizing posteriors by em-ploying energy-based models (EBMs) over low-dimensional subspaces. Specifically, we train a conditional EBM that receives an input measurement and a set of directions that span some low-dimensional subspace of solutions, and outputs the probability density function of the posterior within that space. We demonstrate the effectiveness of our method across a diverse range of datasets and image restoration problems, showcasing its strength in uncertainty quantification and visualization. As we show, our method outperforms a baseline that projects samples from a diffusion-based posterior sampler, while being orders of magnitude faster. Furthermore, it is more accurate than a baseline that assumes a Gaussian posterior. Code is available at https://github.com/yairomer/PPDE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 29002ad2-0ca5-46cd-9cb8-068a7c2c79f4Cited by top-tier papers1
Ask how each one uses itBuilds on26
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Palette: Image-to-Image Diffusion ModelsChitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee et al.SIGGRAPH 2022 · 1,638 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- RePaint: Inpainting using Denoising Diffusion Probabilistic ModelsAndreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu et al.CVPR 2022 · 1,425 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
Related papers
- Learning Energy-Based Models by Diffusion Recovery LikelihoodRuiqi Gao, Yang Song, Ben Poole, Ying Nian Wu et al.ICLR 2021 · 144 citations
- Uncertainty Quantification via Neural Posterior Principal ComponentsElias Nehme, Omer Yair, Tomer MichaeliNeurIPS 2023 · 25 citations
- Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery ApproachSangwoong Yoon, Young-Uk Jin, Yung-Kyun Noh, Frank C. ParkNeurIPS 2023 · 28 citations
- Tomographic Auto-Encoder: Unsupervised Bayesian Recovery of Corrupted DataFrancesco Tonolini, Pablo Garcia Moreno, Andreas C. Damianou, Roderick Murray-SmithICLR 2021 · 1 citation
- Latent Diffusion Energy-Based Model for Interpretable Text ModellingPeiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia et al.ICML 2022 · 105 citations
