Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient Norm
Taeho Yoon, Ernest K. Ryu
2021年份
138被引次数
41顶会引用
摘要
In this work, we study the computational complexity of reducing the squared gradient magnitude for smooth minimax optimization problems. First, we present algorithms with accelerated last-iterate rates, faster than the existing or slower rates for extragradient, Popov, and gradient descent with anchoring. The acceleration mechanism combines extragradient steps with anchoring and is distinct from Nesterov's acceleration. We then establish optimality of the rate through a matching lower bound.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper41
- Closing the Gap: Tighter Analysis of Alternating Stochastic Gradient Methods for Bilevel ProblemsTianyi Chen, Yuejiao Sun, Wotao YinNeurIPS 2021 · 被引用 176 次
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 被引用 125 次
- FedNest: Federated Bilevel, Minimax, and Compositional OptimizationDavoud Ataee Tarzanagh, Mingchen Li, Christos Thrampoulidis, Samet OymakICML 2022 · 被引用 85 次
- Last-Iterate Convergence of Optimistic Gradient Method for Monotone Variational InequalitiesEduard Gorbunov, Adrien B. Taylor, Gauthier GidelNeurIPS 2022 · 被引用 65 次
- Federated Minimax Optimization: Improved Convergence Analyses and AlgorithmsPranay Sharma, Rohan Panda, Gauri Joshi, Pramod K. VarshneyICML 2022 · 被引用 63 次
它引用的顶会 Paper5
- On Gradient Descent Ascent for Nonconvex-Concave Minimax ProblemsTianyi Lin, Chi Jin, Michael I. JordanICML 2020 · 被引用 587 次
- Improved Algorithms for Convex-Concave Minimax OptimizationYuanhao Wang, Jian LiNeurIPS 2020 · 被引用 80 次
- A Catalyst Framework for Minimax OptimizationJunchi Yang, Siqi Zhang, Negar Kiyavash, Niao HeNeurIPS 2020 · 被引用 71 次
- Proximal Gradient Descent-Ascent: Variable Convergence under KŁ GeometryZiyi Chen, Yi Zhou, Tengyu Xu, Yingbin LiangICLR 2021 · 被引用 8 次
- Adaptive Extra-Gradient Methods for Min-Max Optimization and GamesKimon Antonakopoulos, Elena Veronica Belmega, Panayotis MertikopoulosICLR 2021 · 被引用 8 次
相关 Paper
- Optimal Acceleration for Minimax and Fixed-Point Problems is Not UniqueTaeho Yoon, Jaeyeon Kim, Jaewook J. Suh, Ernest K. RyuICML 2024 · 被引用 6 次
- Accelerating Value Iteration with AnchoringJongmin Lee, Ernest K. RyuNeurIPS 2023 · 被引用 20 次
- Accelerated and Stable Convergence with Anchored Generalized Optimistic MethodMotahareh Sohrabi, Jianxin You, Simon Lacoste-Julien, Eduard Gorbunov 等ICML 2026
- Lower Complexity Bounds for Finite-Sum Convex-Concave Minimax Optimization ProblemsGuangzeng Xie, Luo Luo, Yijiang Lian, Zhihua ZhangICML 2020 · 被引用 21 次
- On a Combination of Alternating Minimization and Nesterov's MomentumSergey Guminov, Pavel E. Dvurechensky, Nazarii Tupitsa, Alexander V. GasnikovICML 2021 · 被引用 49 次
