Projection-Free Algorithms for Minimax Problems
Khanh-Hung Giang-Tran, Soroosh Shafiee, Nam Ho-Nguyen
Abstract
This paper addresses constrained smooth saddle-point problems in settings where projection onto the feasible sets is computationally expensive. We bridge the gap between projection-based and projection-free optimization by introducing a unified dual dynamic smoothing framework that enables the design of efficient single-loop algorithms. Within this framework, we establish convergence results for nonconvex-concave and nonconvex-strongly concave settings. Furthermore, we show that this framework is naturally applicable to convex-concave problems, providing a unified analysis across varying payoff structures. We propose and analyze three algorithmic variants based on the application of a linear minimization oracle over the minimization variable, the maximization variable, or both. Notably, our analysis yields anytime convergence guarantees without requiring a pre-specified iteration horizon. These results significantly narrow the performance gap between projection-free and projection-based methods for minimax optimization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- On Gradient Descent Ascent for Nonconvex-Concave Minimax ProblemsTianyi Lin, Chi Jin, Michael I. JordanICML 2020 · 587 citations
- Efficient Projection-free Algorithms for Saddle Point ProblemsCheng Chen, Luo Luo, Weinan Zhang, Yong YuNeurIPS 2020 · 15 citations
- Projection-Free Methods for Solving Nonconvex-Concave Saddle Point ProblemsMorteza Boroun, Erfan Yazdandoost Hamedani, Afrooz JalilzadehNeurIPS 2023 · 8 citations
- Last-Iterate Convergence for Generalized Frank-Wolfe in Monotone Variational InequalitiesZaiwei Chen, Eric MazumdarNeurIPS 2024 · 7 citations
- One-sided Frank-Wolfe algorithms for saddle problemsVladimir Kolmogorov, Thomas PockICML 2021 · 5 citations
Related papers
- A Catalyst Framework for Minimax OptimizationJunchi Yang, Siqi Zhang, Negar Kiyavash, Niao HeNeurIPS 2020 · 71 citations
- Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained OptimizationYankun Huang, Qihang LinNeurIPS 2023 · 20 citations
- The complexity of constrained min-max optimizationConstantinos Daskalakis, Stratis Skoulakis, Manolis ZampetakisSTOC 2021 · 18 citations
- Lower Complexity Bounds for Finite-Sum Convex-Concave Minimax Optimization ProblemsGuangzeng Xie, Luo Luo, Yijiang Lian, Zhihua ZhangICML 2020 · 21 citations
- Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order ApproachAmir Ali Farzin, Yuen-Man Pun, Philipp Braun, Tyler Summers et al.ICML 2026 · 2 citations
