Near-Optimal Φ-Regret Learning in Extensive-Form Games
Ioannis Anagnostides, Gabriele Farina, Tuomas Sandholm
Abstract
In this paper, we establish efficient and uncoupled learning dynamics so that, when employed by all players in multiplayer perfect-recall imperfect-information extensive-form games, the trigger regret of each player grows as after repetitions of play. This improves exponentially over the prior best known trigger-regret bound of , and settles a recent open question by Bai et al. (2022). As an immediate consequence, we guarantee convergence to the set of extensive-form correlated equilibria and coarse correlated equilibria at a near-optimal rate of . Building on prior work, at the heart of our construction lies a more general result regarding fixed points deriving from rational functions with polynomial degree, a property that we establish for the fixed points of (coarse) trigger deviation functions. Moreover, our construction leverages a refined regret circuit for the convex hull, which -- unlike prior guarantees -- preserves the RVU property introduced by Syrgkanis et al. (NIPS, 2015); this observation has an independent interest in establishing near-optimal regret under learning dynamics based on a CFR-type decomposition of the regret.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 329f0b92-42a7-4b75-a108-fa7673936535Cited by top-tier papers6
- Polynomial-Time Linear-Swap Regret Minimization in Imperfect-Information Sequential GamesGabriele Farina, Charilaos PipisNeurIPS 2023 · 13 citations
- Block-Coordinate Methods and Restarting for Solving Extensive-Form GamesDarshan Chakrabarti, Jelena Diakonikolas, Christian KroerNeurIPS 2023 · 8 citations
- Efficient Learning in Polyhedral Games via Best-Response OraclesDarshan Chakrabarti, Gabriele Farina, Christian KroerAAAI 2024 · 4 citations
- Convergence of No-Swap-Regret Dynamics in Self-PlayRenato Paes Leme, Georgios Piliouras, Jon SchneiderNeurIPS 2024 · 3 citations
- Fast Swap Regret Minimization and Applications to Approximate Correlated EquilibriaBinghui Peng, Aviad RubinsteinSTOC 2024 · 2 citations
Builds on21
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 141 citations
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 88 citations
- Uncoupled Learning Dynamics with O(log T) Swap Regret in Multiplayer GamesIoannis Anagnostides, Gabriele Farina, Christian Kroer, Chung-Wei Lee et al.NeurIPS 2022 · 51 citations
- No-Regret Learning Dynamics for Extensive-Form Correlated EquilibriumAndrea Celli, Alberto Marchesi, Gabriele Farina, Nicola GattiNeurIPS 2020 · 48 citations
- Near-Optimal No-Regret Learning Dynamics for General Convex GamesGabriele Farina, Ioannis Anagnostides, Haipeng Luo, Chung-Wei Lee et al.NeurIPS 2022 · 43 citations
Related papers
- Near-optimal no-regret learning for correlated equilibria in multi-player general-sum gamesIoannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Maxwell Fishelson et al.STOC 2022 · 16 citations
- Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex GamesConstantinos Daskalakis, Gabriele Farina, Maxwell Fishelson, Charilaos Pipis et al.STOC 2025 · 14 citations
- Beyond Time-Average Convergence: Near-Optimal Uncoupled Online Learning via Clairvoyant Multiplicative Weights UpdateGeorgios Piliouras, Ryann Sim, Stratis SkoulakisNeurIPS 2022 · 31 citations
- Mediator Interpretation and Faster Learning Algorithms for Linear Correlated Equilibria in General Sequential GamesBrian Hu Zhang, Gabriele Farina, Tuomas SandholmICLR 2024 · 2 citations
- Learning Rationalizable Equilibria in Multiplayer GamesYuanhao Wang, Dingwen Kong, Yu Bai, Chi JinICLR 2023
