Image Restoration via Primal Dual Hybrid Gradient and Flow Generative Model
Ji Li, Chao Wang
Abstract
Regularized optimization has been a classical approach to solving imaging inverse problems, where the regularization term enforces desirable properties of the unknown image. Recently, the integration of flow matching generative models into image restoration has garnered significant attention, owing to their powerful prior modeling capabilities. In this work, we incorporate such generative priors into a Plug-and-Play (PnP) framework based on proximal splitting, where the proximal operator associated with the regularizer is replaced by a time-dependent denoiser derived from the generative model. While existing PnP methods have achieved notable success in inverse problems with smooth squared ℓ2 data fidelity--typically associated with Gaussian noise--their applicability to more general data fidelity terms remains underexplored. To address this, we propose a general and efficient PnP algorithm inspired by the primal-dual hybrid gradient (PDHG) method. Our approach is computationally efficient, memory-friendly, and accommodates a wide range of fidelity terms. In particular, it supports both ℓ1 and ℓ2 norm-based losses, enabling robustness to non-Gaussian noise types such as Poisson and impulse noise. We validate our method on several image restoration tasks, including denoising, super-resolution, deblurring, and inpainting, and demonstrate that ℓ1 and ℓ2 fidelity terms outperform the conventional squared ℓ2 loss in the presence of non-Gaussian noise.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 396d083f-8cec-41f2-ba45-0b645ad4f012Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Diffusion Models as Plug-and-Play PriorsAlexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris SamarasNeurIPS 2022 · 323 citations
- Loss-Guided Diffusion Models for Plug-and-Play Controllable GenerationJiaming Song, Qinsheng Zhang, Hongxu Yin, Morteza Mardani et al.ICML 2023 · 222 citations
Related papers
- PnP-Flow: Plug-and-Play Image Restoration with Flow MatchingSégolène Tiffany Martin, Anne Gagneux, Paul Hagemann, Gabriele SteidlICLR 2025
- Integrating Reweighted Least Squares with Plug-and-Play Diffusion Priors for Noisy Image RestorationJi Li, Chao WangAAAI 2026
- Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse ProblemsSamuel Hurault, Ulugbek Kamilov, Arthur Leclaire, Nicolas PapadakisNeurIPS 2023 · 34 citations
- Gradient Step Denoiser for convergent Plug-and-PlaySamuel Hurault, Arthur Leclaire, Nicolas PapadakisICLR 2022 · 154 citations
- Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex RegularizationSamuel Hurault, Arthur Leclaire, Nicolas PapadakisICML 2022 · 121 citations
