DEALing with Image Reconstruction: Deep Attentive Least Squares
Mehrsa Pourya, Erich Kobler, Michael Unser, Sebastian Neumayer
Abstract
State-of-the-art image reconstruction often relies on complex, abundantly parameterized deep architectures. We propose an alternative: a datadriven reconstruction method inspired by the classic Tikhonov regularization. Our approach iteratively refines intermediate reconstructions by solving a sequence of quadratic problems. These updates have two key components: (i) learned filters to extract salient image features; and (ii) an attention mechanism that locally adjusts the penalty of the filter responses. Our method matches leading plug-and-play and learned regularizer approaches in performance while offering interpretability, robustness, and convergent behavior. In effect, we bridge traditional regularization and deep learning with a principled reconstruction approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on6
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Gradient Step Denoiser for convergent Plug-and-PlaySamuel Hurault, Arthur Leclaire, Nicolas PapadakisICLR 2022 · 154 citations
- Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex RegularizationSamuel Hurault, Arthur Leclaire, Nicolas PapadakisICML 2022 · 121 citations
- Path Independent Equilibrium Models Can Better Exploit Test-Time ComputationCem Anil, Ashwini Pokle, Kaiqu Liang, Johannes Treutlein et al.NeurIPS 2022 · 43 citations
- Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares MinimizationStamatios Lefkimmiatis, Iaroslav KoshelevICLR 2023 · 3 citations
Related papers
- Total Deep Variation for Linear Inverse ProblemsErich Kobler, Alexander Effland, Karl Kunisch, Thomas PockCVPR 2020
- When deep denoising meets iterative phase retrievalYaotian Wang, Xiaohang Sun, Jason W. FleischerICML 2020 · 22 citations
- NPN: Non-Linear Projections of the Null-Space for Imaging Inverse ProblemsRoman Jacome, Romario Gualdrón-Hurtado, León Suárez-Rodríguez, Henry ArguelloNeurIPS 2025 · 4 citations
- DNU: Deep Non-Local Unrolling for Computational Spectral ImagingLizhi Wang, Chen Sun, Maoqing Zhang, Ying Fu et al.CVPR 2020
- Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue ConditionJiaming Liu, M. Salman Asif, Brendt Wohlberg, Ulugbek KamilovNeurIPS 2021 · 55 citations
