GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration
Naoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
Abstract
Pre-trained diffusion models have been successfully used as priors in a variety of linear inverse problems, where the goal is to reconstruct a signal from noisy linear measurements. However, existing approaches require knowledge of the linear operator. In this paper, we propose GibbsDDRM, an extension of Denoising Diffusion Restoration Models (DDRM) to a blind setting in which the linear measurement operator is unknown. GibbsDDRM constructs a joint distribution of the data, measurements, and linear operator by using a pre-trained diffusion model for the data prior, and it solves the problem by posterior sampling with an efficient variant of a Gibbs sampler. The proposed method is problem-agnostic, meaning that a pre-trained diffusion model can be applied to various inverse problems without fine-tuning. In experiments, it achieved high performance on both blind image deblurring and vocal dereverberation tasks, despite the use of simple generic priors for the underlying linear operators.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0c5c4cc5-7188-4658-8306-185a799e33a5Cited by top-tier papers18
- Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of DiffusionDongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata et al.ICLR 2024 · 377 citations
- Direct Diffusion Bridge using Data Consistency for Inverse ProblemsHyungjin Chung, Jeongsol Kim, Jong Chul YeNeurIPS 2023 · 86 citations
- Prompt-tuning Latent Diffusion Models for Inverse ProblemsHyungjin Chung, Jong Chul Ye, Peyman Milanfar, Mauricio DelbracioICML 2024 · 71 citations
- Image Restoration Through Generalized Ornstein-Uhlenbeck BridgeConghan Yue, Zhengwei Peng, Junlong Ma, Shiyan Du et al.ICML 2024 · 48 citations
- Blind Image Restoration via Fast Diffusion InversionHamadi Chihaoui, Abdelhak Lemkhenter, Paolo FavaroNeurIPS 2024 · 46 citations
Builds on17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
Related papers
- A Mixture-Based Framework for Guiding Diffusion ModelsYazid Janati, Badr Moufad, Mehdi Abou El Qassime, Alain Oliviero Durmus et al.ICML 2025
- A Diffusion Model with State Estimation for Degradation-Blind Inverse ImagingLiya Ji, Zhefan Rao, Sinno Jialin Pan, Chenyang Lei et al.AAAI 2024 · 5 citations
- Generative Diffusion Prior for Unified Image Restoration and EnhancementBen Fei, Zhaoyang Lyu, Liang Pan, Junzhe Zhang et al.CVPR 2023
- Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion ModelsLitu Rout, Negin Raoof, Giannis Daras, Constantine Caramanis et al.NeurIPS 2023 · 193 citations
- Listening to the noise: Blind Denoising with Gibbs DiffusionDavid Heurtel-Depeiges, Charles Margossian, Ruben Ohana, Bruno Régaldo-Saint BlancardICML 2024 · 4 citations
