Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion
Yang Cai, Argyris Oikonomou, Weiqiang Zheng
Abstract
We study constrained comonotone min-max optimization, a structured class of nonconvex-nonconcave min-max optimization problems, and their generalization to comonotone inclusion. In our first contribution, we extend the Extra Anchored Gradient (EAG) algorithm, originally proposed by Yoon and Ryu (2021) for unconstrained min-max optimization, to constrained comonotone min-max optimization and comonotone inclusion, achieving an optimal convergence rate of among all first-order methods. Additionally, we prove that the algorithm's iterations converge to a point in the solution set. In our second contribution, we extend the Fast Extra Gradient (FEG) algorithm, as developed by Lee and Kim (2021), to constrained comonotone min-max optimization and comonotone inclusion, achieving the same convergence rate. This rate is applicable to the broadest set of comonotone inclusion problems yet studied in the literature. Our analyses are based on simple potential function arguments, which might be useful for analyzing other accelerated algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- From Average-Iterate to Last-Iterate Convergence in Games: A Reduction and Its ApplicationsYang Cai, Haipeng Luo, Chen-Yu Wei, Weiqiang ZhengNeurIPS 2025 · 9 citations
- COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General PreferencesYixin Liu, Argyris Oikonomou, Weiqiang Zheng, Yang Cai et al.ICLR 2026 · 5 citations
- Expected Variational InequalitiesBrian Hu Zhang, Ioannis Anagnostides, Emanuel Tewolde, Ratip Emin Berker et al.ICML 2025
- Efficient Interpolation between Extragradient and Proximal Methods for Weak MVIsThomas Pethick, Ioannis Mavrothalassitis, Volkan CevherICLR 2025
Builds on17
- Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient NormTaeho Yoon, Ernest K. RyuICML 2021 · 138 citations
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 125 citations
- Tight last-iterate convergence rates for no-regret learning in multi-player gamesNoah Golowich, Sarath Pattathil, Constantinos DaskalakisNeurIPS 2020 · 100 citations
- Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial NetsMingrui Liu, Youssef Mroueh, Jerret Ross, Wei Zhang et al.ICLR 2020 · 67 citations
- Finite-Time Last-Iterate Convergence for Learning in Multi-Player GamesYang Cai, Argyris Oikonomou, Weiqiang ZhengNeurIPS 2022 · 63 citations
Related papers
- Accelerated Single-Call Methods for Constrained Min-Max OptimizationYang Cai, Weiqiang ZhengICLR 2023 · 3 citations
- A Single-Loop Accelerated Extra-Gradient Difference Algorithm with Improved Complexity Bounds for Constrained Minimax OptimizationYuanyuan Liu, Fanhua Shang, Weixin An, Junhao Liu et al.NeurIPS 2023 · 6 citations
- Stochastic Extragradient with Flip-Flop Shuffling & Anchoring: Provable ImprovementsJiseok Chae, Chulhee Yun, Donghwan KimNeurIPS 2024 · 2 citations
- Convergence of Proximal Point and Extragradient-Based Methods Beyond Monotonicity: the Case of Negative ComonotonicityEduard Gorbunov, Adrien B. Taylor, Samuel Horváth, Gauthier GidelICML 2023 · 22 citations
- Accelerated Primal-Dual Gradient Method for Smooth and Convex-Concave Saddle-Point Problems with Bilinear CouplingDmitry Kovalev, Alexander V. Gasnikov, Peter RichtárikNeurIPS 2022 · 45 citations
