Rethinking Gradient Step Denoiser: Towards Truly Pseudo-Contractive Operator
Shuchang Zhang, Yaoyun Zeng, Kangkang Deng, Hongxia Wang
Abstract
Learning pseudo-contractive denoisers is a fundamental challenge in the theoretical analysis of Plug-and-Play (PnP) methods and the Regularization by Denoising (RED) framework. While spectral methods attempt to address this challenge using the power iteration method, they fail to guarantee the truly pseudo-contractive property and suffer from high computational complexity. In this work, we rethink gradient step (GS) denoisers and establish a theoretical connection between GS denoisers and pseudo-contractive operators. We show that GS denoisers, with the gradients of convex potential functions parameterized by input convex neural networks (ICNNs), can achieve truly pseudo-contractive properties. Furthermore, we integrate the learned truly pseudo-contractive denoiser into the RED-PRO (RED via fixed-point projection) model, definitely ensuring convergence in terms of both iterative sequences and objective functions. Extensive numerical experiments confirm that the learned GS denoiser satisfies the truly pseudo-contractive property and, when integrated into RED-PRO, provides a favorable trade-off between interpretability and empirical performance on inverse problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Optimal transport mapping via input convex neural networksAshok Vardhan Makkuva, Amirhossein Taghvaei, Sewoong Oh, Jason D. LeeICML 2020 · 254 citations
- Gradient Step Denoiser for convergent Plug-and-PlaySamuel Hurault, Arthur Leclaire, Nicolas PapadakisICLR 2022 · 154 citations
- Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play PriorsZihui Wu, Yu Sun, Yifan Chen, Bingliang Zhang et al.NeurIPS 2024 · 128 citations
- Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex RegularizationSamuel Hurault, Arthur Leclaire, Nicolas PapadakisICML 2022 · 121 citations
Related papers
- It Has Potential: Gradient-Driven Denoisers for Convergent Solutions to Inverse ProblemsRegev Cohen, Yochai Blau, Daniel Freedman, Ehud RivlinNeurIPS 2021 · 84 citations
- Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue ConditionJiaming Liu, M. Salman Asif, Brendt Wohlberg, Ulugbek KamilovNeurIPS 2021 · 55 citations
- What's in a Prior? Learned Proximal Networks for Inverse ProblemsZhenghan Fang, Sam Buchanan, Jeremias SulamICLR 2024 · 27 citations
- Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Imaging Inverse ProblemsDeliang Wei, Peng Chen, Haobo Xu, Jiale Yao et al.NeurIPS 2025 · 1 citation
- Plug-and-Play image restoration with Stochastic deNOising REgularizationMarien Renaud, Jean Prost, Arthur Leclaire, Nicolas PapadakisICML 2024 · 19 citations
