Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging
He Sun, Katherine L. Bouman
Abstract
Computational image reconstruction algorithms generally produce a single image without any measure of uncertainty or confidence. Regularized Maximum Likelihood (RML) and feed-forward deep learning approaches for inverse problems typically focus on recovering a point estimate. This is a serious limitation when working with under-determined imaging systems, where it is conceivable that multiple image modes would be consistent with the measured data. Characterizing the space of probable images that explain the observational data is therefore crucial. In this paper, we propose a variational deep probabilistic imaging approach to quantify reconstruction uncertainty. Deep Probabilistic Imaging (DPI) employs an untrained deep generative model to estimate a posterior distribution of an unobserved image. This approach does not require any training data; instead, it optimizes the weights of a neural network to generate image samples that fit a particular measurement dataset. Once the network weights have been learned, the posterior distribution can be efficiently sampled. We demonstrate this approach in the context of interferometric radio imaging, which is used for black hole imaging with the Event Horizon Telescope, and compressed sensing Magnetic Resonance Imaging (MRI).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- Score-Based Diffusion Models as Principled Priors for Inverse ImagingBerthy T. Feng, Jamie Smith, Michael Rubinstein, Huiwen Chang et al.ICCV 2023 · 153 citations
- Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play PriorsZihui Wu, Yu Sun, Yifan Chen, Bingliang Zhang et al.NeurIPS 2024 · 128 citations
- What's in a Prior? Learned Proximal Networks for Inverse ProblemsZhenghan Fang, Sam Buchanan, Jeremias SulamICLR 2024 · 27 citations
- DeepGEM: Generalized Expectation-Maximization for Blind InversionAngela F. Gao, Jorge C. Castellanos, Yisong Yue, Zachary E. Ross et al.NeurIPS 2021 · 23 citations
- An Expectation-Maximization Algorithm for Training Clean Diffusion Models from Corrupted ObservationsWeimin Bai, Yifei Wang, Wenzheng Chen, He SunNeurIPS 2024 · 21 citations
Builds on1
Related papers
- A Unified Model for Compressed Sensing MRI Across Undersampling PatternsArmeet Singh Jatyani, Jiayun Wang, Aditi Chandrashekar, Zihui Wu et al.CVPR 2025
- Efficient Noise Calculation in Deep Learning-based MRI ReconstructionsOnat Dalmaz, Arjun D. Desai, Reinhard Heckel, Tolga Çukur et al.ICML 2025
- Uncertainty Modeling in Generative Compressed SensingYilang Zhang, Mengchu Xu, Xiaojun Mao, Jian WangICML 2022 · 6 citations
- Tomographic Auto-Encoder: Unsupervised Bayesian Recovery of Corrupted DataFrancesco Tonolini, Pablo Garcia Moreno, Andreas C. Damianou, Roderick Murray-SmithICLR 2021 · 1 citation
- Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in ImagingAnastasios N. Angelopoulos, Amit Pal Singh Kohli, Stephen Bates, Michael I. Jordan et al.ICML 2022 · 115 citations
