Robust Compressed Sensing MRI with Deep Generative Priors
Ajil Jalal, Marius Arvinte, Giannis Daras, Eric Price, Alexandros G. Dimakis, Jonathan I. Tamir
Abstract
The CSGM framework (Bora-Jalal-Price-Dimakis'17) has shown that deep generative priors can be powerful tools for solving inverse problems. However, to date this framework has been empirically successful only on certain datasets (for example, human faces and MNIST digits), and it is known to perform poorly on out-of-distribution samples. In this paper, we present the first successful application of the CSGM framework on clinical MRI data. We train a generative prior on brain scans from the fastMRI dataset, and show that posterior sampling via Langevin dynamics achieves high quality reconstructions. Furthermore, our experiments and theory show that posterior sampling is robust to changes in the ground-truth distribution and measurement process. Our code and models are available at: https://github.com/utcsilab/csgm-mri-langevin.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f313a051-55a6-423c-a125-2f295bc13637Cited by top-tier papers99
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Solving Inverse Problems in Medical Imaging with Score-Based Generative ModelsYang Song, Liyue Shen, Lei Xing, Stefano ErmonICLR 2022 · 721 citations
- A Variational Perspective on Solving Inverse Problems with Diffusion ModelsMorteza Mardani, Jiaming Song, Jan Kautz, Arash VahdatICLR 2024 · 240 citations
- Loss-Guided Diffusion Models for Plug-and-Play Controllable GenerationJiaming Song, Qinsheng Zhang, Hongxu Yin, Morteza Mardani et al.ICML 2023 · 222 citations
- Solving Inverse Problems with Latent Diffusion Models via Hard Data ConsistencyBowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu et al.ICLR 2024 · 213 citations
Builds on12
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Invertible generative models for inverse problems: mitigating representation error and dataset biasMuhammad Asim, Max Daniels, Oscar Leong, Ali Ahmed et al.ICML 2020 · 172 citations
- Image-Adaptive GAN Based ReconstructionShady Abu Hussein, Tom Tirer, Raja GiryesAAAI 2020 · 104 citations
- Intermediate Layer Optimization for Inverse Problems using Deep Generative ModelsGiannis Daras, Joseph Dean, Ajil Jalal, Alex DimakisICML 2021 · 101 citations
Related papers
- pcaGAN: Improving Posterior-Sampling cGANs via Principal Component RegularizationMatthew C. Bendel, Rizwan Ahmad, Philip SchniterNeurIPS 2024 · 2 citations
- Instance-Optimal Compressed Sensing via Posterior SamplingAjil Jalal, Sushrut Karmalkar, Alex Dimakis, Eric PriceICML 2021 · 62 citations
- Uncertainty Modeling in Generative Compressed SensingYilang Zhang, Mengchu Xu, Xiaojun Mao, Jian WangICML 2022 · 6 citations
- Plug-and-Play Posterior Sampling under Mismatched Measurement and Prior ModelsMarien Renaud, Jiaming Liu, Valentin De Bortoli, Andrés Almansa et al.ICLR 2024 · 7 citations
- A Regularized Conditional GAN for Posterior Sampling in Image Recovery ProblemsMatthew C. Bendel, Rizwan Ahmad, Philip SchniterNeurIPS 2023 · 13 citations
