Solving Constrained Variational Inequalities via a First-order Interior Point-based Method
Tong Yang, Michael I. Jordan, Tatjana Chavdarova
Abstract
We develop an interior-point approach to solve constrained variational inequality (cVI) problems. Inspired by the efficacy of the alternating direction method of multipliers (ADMM) method in the single-objective context, we generalize ADMM to derive a first-order method for cVIs, that we refer to as ADMM-based interior-point method for constrained VIs (ACVI). We provide convergence guarantees for ACVI in two general classes of problems: (i) when the operator is -monotone, and (ii) when it is monotone, some constraints are active and the game is not purely rotational. When the operator is, in addition, L-Lipschitz for the latter case, we match known lower bounds on rates for the gap function of and for the last and average iterate, respectively. To the best of our knowledge, this is the first presentation of a first-order interior-point method for the general cVI problem that has a global convergence guarantee. Moreover, unlike previous work in this setting, ACVI provides a means to solve cVIs when the constraints are nontrivial. Empirical analyses demonstrate clear advantages of ACVI over common first-order methods. In particular, (i) cyclical behavior is notably reduced as our methods approach the solution from the analytic center, and (ii) unlike projection-based methods that zigzag when near a constraint, ACVI efficiently handles the constraints.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Last-Iterate Convergence for Generalized Frank-Wolfe in Monotone Variational InequalitiesZaiwei Chen, Eric MazumdarNeurIPS 2024 · 7 citations
- Randomized Feasibility Methods for Constrained Optimization with Adaptive Step SizesAbhishek Chakraborty, Angelia NedichICML 2026
Builds on7
- Independent Policy Gradient Methods for Competitive Reinforcement LearningConstantinos Daskalakis, Dylan J. Foster, Noah GolowichNeurIPS 2020 · 200 citations
- Linear Last-iterate Convergence in Constrained Saddle-point OptimizationChen-Yu Wei, Chung-Wei Lee, Mengxiao Zhang, Haipeng LuoICLR 2021 · 146 citations
- Tight last-iterate convergence rates for no-regret learning in multi-player gamesNoah Golowich, Sarath Pattathil, Constantinos DaskalakisNeurIPS 2020 · 100 citations
- The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical SetsYa-Ping Hsieh, Panayotis Mertikopoulos, Volkan CevherICML 2021 · 96 citations
- Minimax Classification with 0-1 Loss and Performance GuaranteesSantiago Mazuelas, Andrea Zanoni, Aritz PérezNeurIPS 2020 · 18 citations
Related papers
- A Primal-Dual Approach to Solving Variational Inequalities with General ConstraintsTatjana Chavdarova, Tong Yang, Matteo Pagliardini, Michael I. JordanICLR 2024 · 4 citations
- A Fast Optimistic Method for Monotone Variational InequalitiesMichael Sedlmayer, Dang-Khoa Nguyen, Radu Ioan BotICML 2023 · 7 citations
- Adaptive Gradient Methods for Constrained Convex Optimization and Variational InequalitiesAlina Ene, Huy L. Nguyen, Adrian VladuAAAI 2021 · 35 citations
- Optimal Extragradient-Based Algorithms for Stochastic Variational Inequalities with Separable StructureAngela Yuan, Chris Junchi Li, Gauthier Gidel, Michael I. Jordan et al.NeurIPS 2023 · 2 citations
- Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problemsThomas Pethick, Puya Latafat, Panos Patrinos, Olivier Fercoq et al.ICLR 2022 · 60 citations
