Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems
Thomas Pethick, Puya Latafat, Panos Patrinos, Olivier Fercoq, Volkan Cevher
摘要
This paper introduces a new extragradient-type algorithm for a class of nonconvex-nonconcave minimax problems. It is well-known that finding a local solution for general minimax problems is computationally intractable. This observation has recently motivated the study of structures sufficient for convergence of first order methods in the more general setting of variational inequalities when the so-called weak Minty variational inequality (MVI) holds. This problem class captures non-trivial structures as we demonstrate with examples, for which a large family of existing algorithms provably converge to limit cycles. Our results require a less restrictive parameter range in the weak MVI compared to what is previously known, thus extending the applicability of our scheme. The proposed algorithm is applicable to constrained and regularized problems, and involves an adaptive stepsize allowing for potentially larger stepsizes. Our scheme also converges globally even in settings where the underlying operator exhibits limit cycles.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper23
- No-regret learning in games with noisy feedback: Faster rates and adaptivity via learning rate separationYu-Guan Hsieh, Kimon Antonakopoulos, Volkan Cevher, Panayotis MertikopoulosNeurIPS 2022 · 被引用 38 次
- Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax OptimizationTaoli Zheng, Linglingzhi Zhu, Anthony Man-Cho So, Jose H. Blanchet 等NeurIPS 2023 · 被引用 33 次
- Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone InclusionYang Cai, Argyris Oikonomou, Weiqiang ZhengICML 2024 · 被引用 26 次
- Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax ProblemsPouria Mahdavinia, Yuyang Deng, Haochuan Li, Mehrdad MahdaviNeurIPS 2022 · 被引用 24 次
- Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker ConditionsSayantan Choudhury, Eduard Gorbunov, Nicolas LoizouNeurIPS 2023 · 被引用 24 次
它引用的顶会 Paper7
- What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization?Chi Jin, Praneeth Netrapalli, Michael I. JordanICML 2020 · 被引用 381 次
- Independent Policy Gradient Methods for Competitive Reinforcement LearningConstantinos Daskalakis, Dylan J. Foster, Noah GolowichNeurIPS 2020 · 被引用 200 次
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 被引用 125 次
- The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical SetsYa-Ping Hsieh, Panayotis Mertikopoulos, Volkan CevherICML 2021 · 被引用 96 次
- Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize ScalingYu-Guan Hsieh, Franck Iutzeler, Jérôme Malick, Panayotis MertikopoulosNeurIPS 2020 · 被引用 86 次
相关 Paper
- Weaker MVI Condition: Extragradient Methods with Multi-Step ExplorationYifeng Fan, Yongqiang Li, Bo ChenICLR 2024 · 被引用 5 次
- Solving stochastic weak Minty variational inequalities without increasing batch sizeThomas Pethick, Olivier Fercoq, Puya Latafat, Panagiotis Patrinos 等ICLR 2023 · 被引用 1 次
- Accelerated Single-Call Methods for Constrained Min-Max OptimizationYang Cai, Weiqiang ZhengICLR 2023 · 被引用 3 次
- Solving Stochastic Variational Inequalities without the Bounded Variance AssumptionAhmet Alacaoglu, Jun-Hyun KimICML 2026
- Extragradient Method for -Lipschitz Root-finding ProblemsSayantan Choudhury, Nicolas LoizouNeurIPS 2025 · 被引用 5 次
