Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality
Guy Ohayon, Theo Joseph Adrai, Michael Elad, Tomer Michaeli
摘要
Stochastic restoration algorithms allow to explore the space of solutions that correspond to the degraded input. In this paper we reveal additional fundamental advantages of stochastic methods over deterministic ones, which further motivate their use. First, we prove that any restoration algorithm that attains perfect perceptual quality and whose outputs are consistent with the input must be a posterior sampler, and is thus required to be stochastic. Second, we illustrate that while deterministic restoration algorithms may attain high perceptual quality, this can be achieved only by filling up the space of all possible source images using an extremely sensitive mapping, which makes them highly vulnerable to adversarial attacks. Indeed, we show that enforcing deterministic models to be robust to such attacks profoundly hinders their perceptual quality, while robustifying stochastic models hardly influences their perceptual quality, and improves their output variability. These findings provide a motivation to foster progress in stochastic restoration methods, paving the way to better recovery algorithms.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- Idempotence and Perceptual Image CompressionTongda Xu, Ziran Zhu, Dailan He, Yanghao Li 等ICLR 2024 · 被引用 33 次
- Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image RestorationTheo Adrai, Guy Ohayon, Michael Elad, Tomer MichaeliNeurIPS 2023 · 被引用 22 次
- The Perception-Robustness Tradeoff in Deterministic Image RestorationGuy Ohayon, Tomer Michaeli, Michael EladICML 2024 · 被引用 9 次
- Perceptual Fairness in Image RestorationGuy Ohayon, Michael Elad, Tomer MichaeliNeurIPS 2024 · 被引用 4 次
- pcaGAN: Improving Posterior-Sampling cGANs via Principal Component RegularizationMatthew C. Bendel, Rizwan Ahmad, Philip SchniterNeurIPS 2024 · 被引用 2 次
它引用的顶会 Paper12
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen 等ICCV 2019 · 被引用 1,990 次
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 被引用 1,439 次
- Large Scale Image Completion via Co-Modulated Generative Adversarial NetworksShengyu Zhao, Jonathan Cui, Yilun Sheng, Yue Dong 等ICLR 2021 · 被引用 348 次
- SNIPS: Solving Noisy Inverse Problems StochasticallyBahjat Kawar, Gregory Vaksman, Michael EladNeurIPS 2021 · 被引用 263 次
- Stochastic Solutions for Linear Inverse Problems using the Prior Implicit in a DenoiserZahra Kadkhodaie, Eero P. SimoncelliNeurIPS 2021 · 被引用 202 次
相关 Paper
- Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration ModelsRegev Cohen, Idan Kligvasser, Ehud Rivlin, Daniel FreedmanNeurIPS 2024 · 被引用 26 次
- Deblurring via Stochastic RefinementJay Whang, Mauricio Delbracio, Hossein Talebi, Chitwan Saharia 等CVPR 2022
- Trading off Image Quality for Robustness is not Necessary with Regularized Deterministic AutoencodersAmrutha Saseendran, Kathrin Skubch, Stefan Falkner, Margret KeuperNeurIPS 2022
- SILO: Solving Inverse Problems with Latent OperatorsRon Raphaeli, Sean Man, Michael EladICCV 2025
- Adversarial Counterfactual Visual ExplanationsGuillaume Jeanneret, Loïc Simon, Frédéric JurieCVPR 2023
