Semismooth Newton Algorithm for Efficient Projections onto ℓ1, ∞-norm Ball
Dejun Chu, Changshui Zhang, Shiliang Sun, Qing Tao
Abstract
The structured sparsity-inducing 1,∞ -norm, as a generalization of the classical 1 -norm, plays an important role in jointly sparse models which select or remove simultaneously all the variables forming a group. However, its resulting problem is more difficult to solve than the conventional 1 -norm constrained problem. In this paper, we propose an efficient algorithm for Euclidean projection onto 1,∞ -norm ball. We tackle the projection problem via semismooth Newton algorithm to solve the system of semismooth equations. Meanwhile, exploiting the structure of the Jacobian matrix via LU decomposition yields an equivalent algorithm which is proved to terminate after a finite number of iterations. Empirical studies demonstrate that our proposed algorithm outperforms the existing state-of-the-art solver and is promising for the optimization of learning problems with the 1,∞ -norm ball constraint.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- A Feasible Level Proximal Point Method for Nonconvex Sparse Constrained OptimizationDigvijay Boob, Qi Deng, Guanghui Lan, Yilin WangNeurIPS 2020 · 12 citations
- Manifold Identification for Ultimately Communication-Efficient Distributed OptimizationYu-Sheng Li, Wei-Lin Chiang, Ching-Pei LeeICML 2020 · 6 citations
- Iterative Regularization with k-support Norm: An Important Complement to Sparse RecoveryWilliam de Vazelhes, Bhaskar Mukhoty, Xiao-Tong Yuan, Bin GuAAAI 2024
- Accelerated Projected Gradient Algorithms for Sparsity Constrained Optimization ProblemsJan Harold Alcantara, Ching-pei LeeNeurIPS 2022 · 3 citations
- Smooth Bilevel Programming for Sparse RegularizationClarice Poon, Gabriel PeyréNeurIPS 2021 · 23 citations
