Semismooth Newton Algorithm for Efficient Projections onto ℓ1, ∞-norm Ball
Dejun Chu, Changshui Zhang, Shiliang Sun, Qing Tao
摘要
The structured sparsity-inducing 1,∞ -norm, as a generalization of the classical 1 -norm, plays an important role in jointly sparse models which select or remove simultaneously all the variables forming a group. However, its resulting problem is more difficult to solve than the conventional 1 -norm constrained problem. In this paper, we propose an efficient algorithm for Euclidean projection onto 1,∞ -norm ball. We tackle the projection problem via semismooth Newton algorithm to solve the system of semismooth equations. Meanwhile, exploiting the structure of the Jacobian matrix via LU decomposition yields an equivalent algorithm which is proved to terminate after a finite number of iterations. Empirical studies demonstrate that our proposed algorithm outperforms the existing state-of-the-art solver and is promising for the optimization of learning problems with the 1,∞ -norm ball constraint.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- A Feasible Level Proximal Point Method for Nonconvex Sparse Constrained OptimizationDigvijay Boob, Qi Deng, Guanghui Lan, Yilin WangNeurIPS 2020 · 被引用 12 次
- Manifold Identification for Ultimately Communication-Efficient Distributed OptimizationYu-Sheng Li, Wei-Lin Chiang, Ching-Pei LeeICML 2020 · 被引用 6 次
- Iterative Regularization with k-support Norm: An Important Complement to Sparse RecoveryWilliam de Vazelhes, Bhaskar Mukhoty, Xiao-Tong Yuan, Bin GuAAAI 2024
- Accelerated Projected Gradient Algorithms for Sparsity Constrained Optimization ProblemsJan Harold Alcantara, Ching-pei LeeNeurIPS 2022 · 被引用 3 次
- Smooth Bilevel Programming for Sparse RegularizationClarice Poon, Gabriel PeyréNeurIPS 2021 · 被引用 23 次
