Learning to solve TV regularised problems with unrolled algorithms
Hamza Cherkaoui, Jeremias Sulam, Thomas Moreau
摘要
Total Variation (TV) is a popular regularization strategy that promotes piece-wise constant signals by constraining the 1 -norm of the first order derivative of the estimated signal. The resulting optimization problem is usually solved using iterative algorithms such as proximal gradient descent, primal-dual algorithms or ADMM. However, such methods can require a very large number of iterations to converge to a suitable solution. In this paper, we accelerate such iterative algorithms by unfolding proximal gradient descent solvers in order to learn their parameters for 1D TV regularized problems. While this could be done using the synthesis formulation, we demonstrate that this leads to slower performances. The main difficulty in applying such methods in the analysis formulation lies in proposing a way to compute the derivatives through the proximal operator. As our main contribution, we develop and characterize two approaches to do so, describe their benefits and limitations, and discuss the regime where they can actually improve over iterative procedures. We validate those findings with experiments on synthetic and real data. 34th Conference on Neural Information Processing Systems (NeurIPS 2020),
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Efficient and Modular Implicit DifferentiationMathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig 等NeurIPS 2022 · 被引用 386 次
- Total Variation Optimization Layers for Computer VisionRaymond A. Yeh, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. SchwingCVPR 2022 · 被引用 9 次
- Non-Asymptotic Uncertainty Quantification in High-Dimensional LearningFrederik Hoppe, Claudio Mayrink Verdun, Hannah Laus, Felix Krahmer 等NeurIPS 2024 · 被引用 5 次
- Double Momentum Method for Lower-Level Constrained Bilevel OptimizationWanli Shi, Yi Chang, Bin GuICML 2024 · 被引用 2 次
它引用的顶会 Paper1
相关 Paper
- Automatic Differentiation of Optimization Algorithms with Time-Varying UpdatesSheheryar Mehmood, Peter OchsICML 2025
- Time-Embedded Algorithm Unrolling for Computational MRIJunno Yun, Yasar Utku Alçalar, Mehmet AkçakayaNeurIPS 2025 · 被引用 9 次
- Deeply Learned Spectral Total Variation DecompositionTamara G. Grossmann, Yury Korolev, Guy Gilboa, Carola B. SchönliebNeurIPS 2020 · 被引用 5 次
- Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel ImagingPing Wang, Lishun Wang, Gang Qu, Xiaodong Wang 等CVPR 2025
- End-to-end reconstruction meets data-driven regularization for inverse problemsSubhadip Mukherjee, Marcello Carioni, Ozan Öktem, Carola-Bibiane SchönliebNeurIPS 2021 · 被引用 54 次
