Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework
Rajesh Shrestha, Xiao Fu
摘要
While score-based generative models have emerged as powerful priors for solving inverse problems, directly integrating them into optimization algorithms such as ADMM remains nontrivial. Two central challenges arise: i) the mismatch between the noisy data manifolds used to train the score functions and the geometry of ADMM iterates, especially due to the influence of dual variables, and ii) the lack of convergence understanding when ADMM is equipped with score-based denoisers. To address the manifold mismatch issue, we propose ADMM plug-andplay (ADMM-PnP) with the AC-DC denoiser, a new framework that embeds a three-stage denoiser into ADMM: (1) auto-correction (AC) via additive Gaussian noise, (2) directional correction (DC) using conditional Langevin dynamics, and (3) score-based denoising. In terms of convergence, we establish two results: first, under proper denoiser parameters, each ADMM iteration is a weakly nonexpansive operator, ensuring high-probability fixed-point ball convergence using a constant step size; second, under more relaxed conditions, the AC-DC denoiser is a bounded denoiser, which leads to convergence under an adaptive step size schedule. Experiments on a range of inverse problems demonstrate that our method consistently improves solution quality over a variety of baselines. Source code is publicly available at https://github.com/rajeshshrestha/ACDC.git .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper26
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song 等ICLR 2022 · 被引用 2,128 次
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 被引用 1,439 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Improving Diffusion Models for Inverse Problems using Manifold ConstraintsHyungjin Chung, Byeongsu Sim, Dohoon Ryu, Jong Chul YeNeurIPS 2022 · 被引用 738 次
相关 Paper
- Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex RegularizationSamuel Hurault, Arthur Leclaire, Nicolas PapadakisICML 2022 · 被引用 121 次
- Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse ProblemsSamuel Hurault, Ulugbek Kamilov, Arthur Leclaire, Nicolas PapadakisNeurIPS 2023 · 被引用 34 次
- Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence AnalysisShirin Shoushtari, Jiaming Liu, Edward P. Chandler, M. Salman Asif 等ICML 2024 · 被引用 9 次
- Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image ReconstructionXingyu Xu, Yuejie ChiNeurIPS 2024 · 被引用 92 次
- PnP-Flow: Plug-and-Play Image Restoration with Flow MatchingSégolène Tiffany Martin, Anne Gagneux, Paul Hagemann, Gabriele SteidlICLR 2025
