Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion
Yang Cai, Argyris Oikonomou, Weiqiang Zheng
摘要
We study constrained comonotone min-max optimization, a structured class of nonconvex-nonconcave min-max optimization problems, and their generalization to comonotone inclusion. In our first contribution, we extend the Extra Anchored Gradient (EAG) algorithm, originally proposed by Yoon and Ryu (2021) for unconstrained min-max optimization, to constrained comonotone min-max optimization and comonotone inclusion, achieving an optimal convergence rate of among all first-order methods. Additionally, we prove that the algorithm's iterations converge to a point in the solution set. In our second contribution, we extend the Fast Extra Gradient (FEG) algorithm, as developed by Lee and Kim (2021), to constrained comonotone min-max optimization and comonotone inclusion, achieving the same convergence rate. This rate is applicable to the broadest set of comonotone inclusion problems yet studied in the literature. Our analyses are based on simple potential function arguments, which might be useful for analyzing other accelerated algorithms.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- From Average-Iterate to Last-Iterate Convergence in Games: A Reduction and Its ApplicationsYang Cai, Haipeng Luo, Chen-Yu Wei, Weiqiang ZhengNeurIPS 2025 · 被引用 9 次
- COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General PreferencesYixin Liu, Argyris Oikonomou, Weiqiang Zheng, Yang Cai 等ICLR 2026 · 被引用 5 次
- Expected Variational InequalitiesBrian Hu Zhang, Ioannis Anagnostides, Emanuel Tewolde, Ratip Emin Berker 等ICML 2025
- Efficient Interpolation between Extragradient and Proximal Methods for Weak MVIsThomas Pethick, Ioannis Mavrothalassitis, Volkan CevherICLR 2025
它引用的顶会 Paper17
- Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient NormTaeho Yoon, Ernest K. RyuICML 2021 · 被引用 138 次
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 被引用 125 次
- Tight last-iterate convergence rates for no-regret learning in multi-player gamesNoah Golowich, Sarath Pattathil, Constantinos DaskalakisNeurIPS 2020 · 被引用 100 次
- Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial NetsMingrui Liu, Youssef Mroueh, Jerret Ross, Wei Zhang 等ICLR 2020 · 被引用 67 次
- Finite-Time Last-Iterate Convergence for Learning in Multi-Player GamesYang Cai, Argyris Oikonomou, Weiqiang ZhengNeurIPS 2022 · 被引用 63 次
相关 Paper
- Accelerated Single-Call Methods for Constrained Min-Max OptimizationYang Cai, Weiqiang ZhengICLR 2023 · 被引用 3 次
- A Single-Loop Accelerated Extra-Gradient Difference Algorithm with Improved Complexity Bounds for Constrained Minimax OptimizationYuanyuan Liu, Fanhua Shang, Weixin An, Junhao Liu 等NeurIPS 2023 · 被引用 6 次
- Stochastic Extragradient with Flip-Flop Shuffling & Anchoring: Provable ImprovementsJiseok Chae, Chulhee Yun, Donghwan KimNeurIPS 2024 · 被引用 2 次
- Convergence of Proximal Point and Extragradient-Based Methods Beyond Monotonicity: the Case of Negative ComonotonicityEduard Gorbunov, Adrien B. Taylor, Samuel Horváth, Gauthier GidelICML 2023 · 被引用 22 次
- Accelerated Primal-Dual Gradient Method for Smooth and Convex-Concave Saddle-Point Problems with Bilinear CouplingDmitry Kovalev, Alexander V. Gasnikov, Peter RichtárikNeurIPS 2022 · 被引用 45 次
