Learning Nash Equilibria in Rank-1 Games
Nikolas Patris, Ioannis Panageas
摘要
Learning Nash equilibria (NE) in games has garnered significant attention, particularly in the context of training Generative Adversarial Networks (GANs) and multi-agent Reinforcement Learning. The current state-of-the-art in efficiently learning NE in games focuses on landscapes that meet the (weak) minty property or games characterized by a unique function, often referred to as potential games. A significant challenge in this domain is that computing Nash equilibria is a computationally intractable task Daskalakis et al. (2009) . In this paper we focus on bimatrix games (A, B) called rank-1. These are games in which the sum of the payoff matrices A + B is a rank 1 matrix; note that standard zero-sum games are rank-0. We show that a modification of optimistic mirror descent converges to an ϵ-approximate NE after O 1 ϵ 2 log( 1 ϵ ) iterates in rank-1 games. We achieve this by leveraging structural results about the NE landscape of rank-1 games Adsul et al. ( 2021 ). Notably, our approach bypasses the fact that these games do not satisfy the MVI property.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Multi-Objective Reinforcement Learning with Max-Min Criterion: A Game-Theoretic ApproachWoohyeon Byeon, Giseung Park, Jongseong Chae, Amir Leshem 等NeurIPS 2025 · 被引用 6 次
- Expected Variational InequalitiesBrian Hu Zhang, Ioannis Anagnostides, Emanuel Tewolde, Ratip Emin Berker 等ICML 2025
它引用的顶会 Paper7
- What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization?Chi Jin, Praneeth Netrapalli, Michael I. JordanICML 2020 · 被引用 381 次
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 被引用 88 次
- Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problemsThomas Pethick, Puya Latafat, Panos Patrinos, Olivier Fercoq 等ICLR 2022 · 被引用 60 次
- Optimistic Dual Extrapolation for Coherent Non-monotone Variational InequalitiesChaobing Song, Zhengyuan Zhou, Yichao Zhou, Yong Jiang 等NeurIPS 2020 · 被引用 55 次
- On Last-Iterate Convergence Beyond Zero-Sum GamesIoannis Anagnostides, Ioannis Panageas, Gabriele Farina, Tuomas SandholmICML 2022 · 被引用 52 次
相关 Paper
- On the Interplay between Social Welfare and Tractability of EquilibriaIoannis Anagnostides, Tuomas SandholmNeurIPS 2023 · 被引用 3 次
- Optimistic Mirror Descent Either Converges to Nash or to Strong Coarse Correlated Equilibria in Bimatrix GamesIoannis Anagnostides, Gabriele Farina, Ioannis Panageas, Tuomas SandholmNeurIPS 2022 · 被引用 14 次
- Fast computation of Nash Equilibria in Imperfect Information GamesRémi Munos, Julien Pérolat, Jean-Baptiste Lespiau, Mark Rowland 等ICML 2020 · 被引用 11 次
- Learning Equilibria in Adversarial Team Markov Games: A Nonconvex-Hidden-Concave Min-Max Optimization ProblemFivos Kalogiannis, Jingming Yan, Ioannis PanageasNeurIPS 2024 · 被引用 10 次
- Adaptively Perturbed Mirror Descent for Learning in GamesKenshi Abe, Kaito Ariu, Mitsuki Sakamoto, Atsushi IwasakiICML 2024 · 被引用 10 次
