Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems
Thomas Pethick, Puya Latafat, Panos Patrinos, Olivier Fercoq, Volkan Cevher
Abstract
This paper introduces a new extragradient-type algorithm for a class of nonconvex-nonconcave minimax problems. It is well-known that finding a local solution for general minimax problems is computationally intractable. This observation has recently motivated the study of structures sufficient for convergence of first order methods in the more general setting of variational inequalities when the so-called weak Minty variational inequality (MVI) holds. This problem class captures non-trivial structures as we demonstrate with examples, for which a large family of existing algorithms provably converge to limit cycles. Our results require a less restrictive parameter range in the weak MVI compared to what is previously known, thus extending the applicability of our scheme. The proposed algorithm is applicable to constrained and regularized problems, and involves an adaptive stepsize allowing for potentially larger stepsizes. Our scheme also converges globally even in settings where the underlying operator exhibits limit cycles.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9e50eda-a58a-4409-98ff-3144434947cbCited by top-tier papers23
- No-regret learning in games with noisy feedback: Faster rates and adaptivity via learning rate separationYu-Guan Hsieh, Kimon Antonakopoulos, Volkan Cevher, Panayotis MertikopoulosNeurIPS 2022 · 38 citations
- Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax OptimizationTaoli Zheng, Linglingzhi Zhu, Anthony Man-Cho So, Jose H. Blanchet et al.NeurIPS 2023 · 33 citations
- Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone InclusionYang Cai, Argyris Oikonomou, Weiqiang ZhengICML 2024 · 26 citations
- Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax ProblemsPouria Mahdavinia, Yuyang Deng, Haochuan Li, Mehrdad MahdaviNeurIPS 2022 · 24 citations
- Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker ConditionsSayantan Choudhury, Eduard Gorbunov, Nicolas LoizouNeurIPS 2023 · 24 citations
Builds on7
- What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization?Chi Jin, Praneeth Netrapalli, Michael I. JordanICML 2020 · 381 citations
- Independent Policy Gradient Methods for Competitive Reinforcement LearningConstantinos Daskalakis, Dylan J. Foster, Noah GolowichNeurIPS 2020 · 200 citations
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 125 citations
- The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical SetsYa-Ping Hsieh, Panayotis Mertikopoulos, Volkan CevherICML 2021 · 96 citations
- Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize ScalingYu-Guan Hsieh, Franck Iutzeler, Jérôme Malick, Panayotis MertikopoulosNeurIPS 2020 · 86 citations
Related papers
- Weaker MVI Condition: Extragradient Methods with Multi-Step ExplorationYifeng Fan, Yongqiang Li, Bo ChenICLR 2024 · 5 citations
- Solving stochastic weak Minty variational inequalities without increasing batch sizeThomas Pethick, Olivier Fercoq, Puya Latafat, Panagiotis Patrinos et al.ICLR 2023 · 1 citation
- Accelerated Single-Call Methods for Constrained Min-Max OptimizationYang Cai, Weiqiang ZhengICLR 2023 · 3 citations
- Solving Stochastic Variational Inequalities without the Bounded Variance AssumptionAhmet Alacaoglu, Jun-Hyun KimICML 2026
- Extragradient Method for -Lipschitz Root-finding ProblemsSayantan Choudhury, Nicolas LoizouNeurIPS 2025 · 5 citations
