Near-Optimal Φ-Regret Learning in Extensive-Form Games
Ioannis Anagnostides, Gabriele Farina, Tuomas Sandholm
摘要
In this paper, we establish efficient and uncoupled learning dynamics so that, when employed by all players in multiplayer perfect-recall imperfect-information extensive-form games, the trigger regret of each player grows as after repetitions of play. This improves exponentially over the prior best known trigger-regret bound of , and settles a recent open question by Bai et al. (2022). As an immediate consequence, we guarantee convergence to the set of extensive-form correlated equilibria and coarse correlated equilibria at a near-optimal rate of . Building on prior work, at the heart of our construction lies a more general result regarding fixed points deriving from rational functions with polynomial degree, a property that we establish for the fixed points of (coarse) trigger deviation functions. Moreover, our construction leverages a refined regret circuit for the convex hull, which -- unlike prior guarantees -- preserves the RVU property introduced by Syrgkanis et al. (NIPS, 2015); this observation has an independent interest in establishing near-optimal regret under learning dynamics based on a CFR-type decomposition of the regret.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper6
- Polynomial-Time Linear-Swap Regret Minimization in Imperfect-Information Sequential GamesGabriele Farina, Charilaos PipisNeurIPS 2023 · 被引用 13 次
- Block-Coordinate Methods and Restarting for Solving Extensive-Form GamesDarshan Chakrabarti, Jelena Diakonikolas, Christian KroerNeurIPS 2023 · 被引用 8 次
- Efficient Learning in Polyhedral Games via Best-Response OraclesDarshan Chakrabarti, Gabriele Farina, Christian KroerAAAI 2024 · 被引用 4 次
- Convergence of No-Swap-Regret Dynamics in Self-PlayRenato Paes Leme, Georgios Piliouras, Jon SchneiderNeurIPS 2024 · 被引用 3 次
- Fast Swap Regret Minimization and Applications to Approximate Correlated EquilibriaBinghui Peng, Aviad RubinsteinSTOC 2024 · 被引用 2 次
它引用的顶会 Paper21
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 被引用 141 次
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 被引用 88 次
- Uncoupled Learning Dynamics with O(log T) Swap Regret in Multiplayer GamesIoannis Anagnostides, Gabriele Farina, Christian Kroer, Chung-Wei Lee 等NeurIPS 2022 · 被引用 51 次
- No-Regret Learning Dynamics for Extensive-Form Correlated EquilibriumAndrea Celli, Alberto Marchesi, Gabriele Farina, Nicola GattiNeurIPS 2020 · 被引用 48 次
- Near-Optimal No-Regret Learning Dynamics for General Convex GamesGabriele Farina, Ioannis Anagnostides, Haipeng Luo, Chung-Wei Lee 等NeurIPS 2022 · 被引用 43 次
相关 Paper
- Near-optimal no-regret learning for correlated equilibria in multi-player general-sum gamesIoannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Maxwell Fishelson 等STOC 2022 · 被引用 16 次
- Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex GamesConstantinos Daskalakis, Gabriele Farina, Maxwell Fishelson, Charilaos Pipis 等STOC 2025 · 被引用 14 次
- Beyond Time-Average Convergence: Near-Optimal Uncoupled Online Learning via Clairvoyant Multiplicative Weights UpdateGeorgios Piliouras, Ryann Sim, Stratis SkoulakisNeurIPS 2022 · 被引用 31 次
- Mediator Interpretation and Faster Learning Algorithms for Linear Correlated Equilibria in General Sequential GamesBrian Hu Zhang, Gabriele Farina, Tuomas SandholmICLR 2024 · 被引用 2 次
- Learning Rationalizable Equilibria in Multiplayer GamesYuanhao Wang, Dingwen Kong, Yu Bai, Chi JinICLR 2023
