From Lyapunov Analysis to Algorithm Design in two-sided PL Minimax Optimization
Mansi Rankawat, Michael Muehlebach, Simon Lacoste-Julien, Damien Scieur
Abstract
We derive algorithms for smooth nonconvex nonconcave minimax optimization and establish linear convergence rates for problems that satisfy the two-sided Polyak-Lojasiewicz (PL) inequality. At the core of our approach is the observation that Lyapunov functions can be used not only to certify convergence a posteriori, but also to design algorithms. By replacing an idealized, intractable Lyapunov function with a computable surrogate based on gradient information, we derive TALDA (Tri-Action Lyapunov Descent Ascent), a single-loop algorithm that enforces Lyapunov descent by construction. TALDA guarantees linear convergence under the two-sided PL condition, with a rate that depends explicitly on the cross-smoothness constant. This recovers existing worst-case guarantees while yielding sharper convergence rates in weakly coupled min–max problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 977bc6eb-6ea8-45d4-b3d7-08f7e2f1bd4fBuilds on9
- On Gradient Descent Ascent for Nonconvex-Concave Minimax ProblemsTianyi Lin, Chi Jin, Michael I. JordanICML 2020 · 587 citations
- Global Convergence and Variance Reduction for a Class of Nonconvex-Nonconcave Minimax ProblemsJunchi Yang, Negar Kiyavash, Niao HeNeurIPS 2020 · 136 citations
- The First Optimal Algorithm for Smooth and Strongly-Convex-Strongly-Concave Minimax OptimizationDmitry Kovalev, Alexander V. GasnikovNeurIPS 2022 · 36 citations
- Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax OptimizationTaoli Zheng, Linglingzhi Zhu, Anthony Man-Cho So, Jose H. Blanchet et al.NeurIPS 2023 · 33 citations
- Solving Min-Max Optimization with Hidden Structure via Gradient Descent AscentEmmanouil V. Vlatakis-Gkaragkounis, Lampros Flokas, Georgios PiliourasNeurIPS 2021 · 16 citations
Related papers
- Proximal Gradient Descent-Ascent: Variable Convergence under KŁ GeometryZiyi Chen, Yi Zhou, Tengyu Xu, Yingbin LiangICLR 2021 · 8 citations
- SGDA with shuffling: faster convergence for nonconvex-PŁ minimax optimizationHanseul Cho, Chulhee YunICLR 2023
- TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax OptimizationXiang Li, Junchi Yang, Niao HeICLR 2023
- Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax OptimizationJunchi Yang, Xiang Li, Niao HeNeurIPS 2022 · 29 citations
- Faster Stochastic Algorithms for Minimax Optimization under Polyak-ojasiewicz ConditionLesi Chen, Boyuan Yao, Luo LuoNeurIPS 2022 · 24 citations
