Solving Inverse Problems with a Flow-based Noise Model
Jay Whang, Qi Lei, Alex Dimakis
Abstract
We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise models with arbitrary dependencies as well as non-linear forward operators. We empirically validate the efficacy of our method on various inverse problems, including compressed sensing with quantized measurements and denoising with highly structured noise patterns. We also present initial theoretical recovery guarantees for solving inverse problems with a flow prior.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ae122403-3dc1-4fad-a53f-258cda64a58eCited by top-tier papers11
- D-Flow: Differentiating through Flows for Controlled GenerationHeli Ben-Hamu, Omri Puny, Itai Gat, Brian Karrer et al.ICML 2024 · 82 citations
- GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion RestorationNaoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida et al.ICML 2023 · 75 citations
- Prompt-tuning Latent Diffusion Models for Inverse ProblemsHyungjin Chung, Jong Chul Ye, Peyman Milanfar, Mauricio DelbracioICML 2024 · 71 citations
- BlindHarmony: "Blind" Harmonization for MR Images via Flow modelHwihun Jeong, Heejoon Byun, Dong Un Kang, Jongho LeeICCV 2023 · 12 citations
- Optimization for Amortized Inverse ProblemsTianci Liu, Tong Yang, Quan Zhang, Qi LeiICML 2023 · 7 citations
Builds on5
- Invertible generative models for inverse problems: mitigating representation error and dataset biasMuhammad Asim, Max Daniels, Oscar Leong, Ali Ahmed et al.ICML 2020 · 172 citations
- GAN-Based Projector for Faster Recovery With Convergence Guarantees in Linear Inverse ProblemsAnkit Raj, Yuqi Li, Yoram BreslerICCV 2019 · 61 citations
- Source Separation with Deep Generative PriorsVivek Jayaram, John ThickstunICML 2020 · 47 citations
- Flow Contrastive Estimation of Energy-Based ModelsRuiqi Gao, Erik Nijkamp, Diederik P. Kingma, Zhen Xu et al.CVPR 2020
- PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative ModelsSachit Menon, Alexandru Damian, Shijia Hu, Nikhil Ravi et al.CVPR 2020
Related papers
- Composing Normalizing Flows for Inverse ProblemsJay Whang, Erik M. Lindgren, Alex DimakisICML 2021 · 56 citations
- A Diffusion Model with State Estimation for Degradation-Blind Inverse ImagingLiya Ji, Zhefan Rao, Sinno Jialin Pan, Chenyang Lei et al.AAAI 2024 · 5 citations
- A Conditional Normalizing Flow for Accelerated Multi-Coil MR ImagingJeffrey Wen, Rizwan Ahmad, Philip SchniterICML 2023 · 12 citations
- Instance-Optimal Compressed Sensing via Posterior SamplingAjil Jalal, Sushrut Karmalkar, Alex Dimakis, Eric PriceICML 2021 · 62 citations
- Sparse Bayesian Generative Modeling for Compressive SensingBenedikt Böck, Sadaf Syed, Wolfgang UtschickNeurIPS 2024 · 5 citations
