Accelerated and Stable Convergence with Anchored Generalized Optimistic Method
Motahareh Sohrabi, Jianxin You, Simon Lacoste-Julien, Eduard Gorbunov, Gauthier Gidel
Abstract
We study first-order methods for solving monotone variational inequalities arising in min-max optimization. Classical approaches such as the extragradient method rely on two gradient queries per iteration, which limits their analysis and applicability in the online and stochastic settings. We propose a family of Generalized Optimistic Methods with Anchoring (GOMA), which combine two-time-scale optimistic updates with an anchoring term inspired by Halpern iteration. In the deterministic setting, GOMA achieves the optimal accelerated last-iterate rate on the squared gradient norm for monotone Lipschitz operators. In the stochastic setting with unbounded variance, a simplified single-call variant of GOMA achieves a last-iterate convergence rate of on the squared gradient norm. To the best of our knowledge, this is the first such guarantee for stochastic monotone Lipschitz VIs in the unconstrained setting without variance reduction or growing batches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on18
- Responsive Safety in Reinforcement Learning by PID Lagrangian MethodsAdam Stooke, Joshua Achiam, Pieter AbbeelICML 2020 · 403 citations
- Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient NormTaeho Yoon, Ernest K. RyuICML 2021 · 138 citations
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 125 citations
- Tight last-iterate convergence rates for no-regret learning in multi-player gamesNoah Golowich, Sarath Pattathil, Constantinos DaskalakisNeurIPS 2020 · 100 citations
- Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize ScalingYu-Guan Hsieh, Franck Iutzeler, Jérôme Malick, Panayotis MertikopoulosNeurIPS 2020 · 86 citations
Related papers
- Adaptive and Universal Algorithms for Variational Inequalities with Optimal ConvergenceAlina Ene, Huy Le NguyenAAAI 2022 · 18 citations
- Last-Iterate Convergence of Regularized Gradient Methods for Stochastic Monotone Variational InequalitiesShinji Ito, Taira Tsuchiya, Kaito Ariu, Kenshi AbeICML 2026
- Accelerated Single-Call Methods for Constrained Min-Max OptimizationYang Cai, Weiqiang ZhengICLR 2023 · 3 citations
- Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker ConditionsSayantan Choudhury, Eduard Gorbunov, Nicolas LoizouNeurIPS 2023 · 24 citations
- Last-Iterate Convergence of Optimistic Gradient Method for Monotone Variational InequalitiesEduard Gorbunov, Adrien B. Taylor, Gauthier GidelNeurIPS 2022 · 65 citations
