Uncoupled Learning Dynamics with O(log T) Swap Regret in Multiplayer Games
Ioannis Anagnostides, Gabriele Farina, Christian Kroer, Chung-Wei Lee, Haipeng Luo, Tuomas Sandholm
摘要
In this paper we establish efficient and uncoupled learning dynamics so that, when employed by all players in a general-sum multiplayer game, the swap regret of each player after repetitions of the game is bounded by , improving over the prior best bounds of . At the same time, we guarantee optimal swap regret in the adversarial regime as well. To obtain these results, our primary contribution is to show that when all players follow our dynamics with a time-invariant learning rate, the second-order path lengths of the dynamics up to time are bounded by , a fundamental property which could have further implications beyond near-optimally bounding the (swap) regret. Our proposed learning dynamics combine in a novel way optimistic regularized learning with the use of self-concordant barriers. Further, our analysis is remarkably simple, bypassing the cumbersome framework of higher-order smoothness recently developed by Daskalakis, Fishelson, and Golowich (NeurIPS'21).
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper27
- Meta-Learning in GamesKeegan Harris, Ioannis Anagnostides, Gabriele Farina, Mikhail Khodak 等ICLR 2023 · 被引用 196 次
- Near-Optimal No-Regret Learning Dynamics for General Convex GamesGabriele Farina, Ioannis Anagnostides, Haipeng Luo, Chung-Wei Lee 等NeurIPS 2022 · 被引用 43 次
- No-regret learning in games with noisy feedback: Faster rates and adaptivity via learning rate separationYu-Guan Hsieh, Kimon Antonakopoulos, Volkan Cevher, Panayotis MertikopoulosNeurIPS 2022 · 被引用 38 次
- Regret Minimization and Convergence to Equilibria in General-sum Markov GamesLiad Erez, Tal Lancewicki, Uri Sherman, Tomer Koren 等ICML 2023 · 被引用 35 次
- Beyond Time-Average Convergence: Near-Optimal Uncoupled Online Learning via Clairvoyant Multiplicative Weights UpdateGeorgios Piliouras, Ryann Sim, Stratis SkoulakisNeurIPS 2022 · 被引用 31 次
它引用的顶会 Paper4
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 被引用 141 次
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 被引用 88 次
- On Last-Iterate Convergence Beyond Zero-Sum GamesIoannis Anagnostides, Ioannis Panageas, Gabriele Farina, Tuomas SandholmICML 2022 · 被引用 52 次
- Near-optimal no-regret learning for correlated equilibria in multi-player general-sum gamesIoannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Maxwell Fishelson 等STOC 2022 · 被引用 16 次
相关 Paper
- Faster Rates for No-Regret Learning in General Games via Cautious OptimismAshkan Soleymani, Georgios Piliouras, Gabriele FarinaSTOC 2025 · 被引用 1 次
- Near-Optimal Φ-Regret Learning in Extensive-Form GamesIoannis Anagnostides, Gabriele Farina, Tuomas SandholmICML 2023 · 被引用 7 次
- Optimistic Mirror Descent Either Converges to Nash or to Strong Coarse Correlated Equilibria in Bimatrix GamesIoannis Anagnostides, Gabriele Farina, Ioannis Panageas, Tuomas SandholmNeurIPS 2022 · 被引用 14 次
- Doubly Optimal No-Regret Learning in Monotone GamesYang Cai, Weiqiang ZhengICML 2023 · 被引用 23 次
- Tight last-iterate convergence rates for no-regret learning in multi-player gamesNoah Golowich, Sarath Pattathil, Constantinos DaskalakisNeurIPS 2020 · 被引用 100 次
