Connecting Optimal Ex-Ante Collusion in Teams to Extensive-Form Correlation: Faster Algorithms and Positive Complexity Results
Gabriele Farina, Andrea Celli, Nicola Gatti, Tuomas Sandholm
Abstract
We focus on the problem of finding an optimal strategy for a team of players that faces an opponent in an imperfect-information zero-sum extensive-form game. Team members are not allowed to communicate during play but can coordinate before the game. In this setting, it is known that the best the team can do is sample a profile of potentially randomized strategies (one per player) from a joint (a.k.a. correlated) probability distribution at the beginning of the game. In this paper, we first provide new modeling results about computing such an optimal distribution by drawing a connection to a different literature on extensive-form correlation. Second, we provide an algorithm that allows one for capping the number of profiles employed in the solution. This begets an anytime algorithm by increasing the cap. We find that often a handful of well-chosen such profiles suffices to reach optimal utility for the team. This enables team members to reach coordination through a simple and understandable plan. Finally, inspired by this observation and leveraging theoretical concepts that we introduce, we develop an efficient column-generation algorithm for finding an optimal distribution for the team. We evaluate it on a suite of common benchmark games. It is three orders of magnitude faster than the prior state of the art on games that the latter can solve and it can also solve several games that were previously unsolvable.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a87dd3da-2ce0-448e-8d10-04b92865e343Cited by top-tier papers7
- A Marriage between Adversarial Team Games and 2-player Games: Enabling Abstractions, No-regret Learning, and Subgame SolvingLuca Carminati, Federico Cacciamani, Marco Ciccone, Nicola GattiICML 2022 · 18 citations
- Team-PSRO for Learning Approximate TMECor in Large Team Games via Cooperative Reinforcement LearningStephen McAleer, Gabriele Farina, Gaoyue Zhou, Mingzhi Wang et al.NeurIPS 2023 · 18 citations
- Team Belief DAG: Generalizing the Sequence Form to Team Games for Fast Computation of Correlated Team Max-Min Equilibria via Regret MinimizationBrian Hu Zhang, Gabriele Farina, Tuomas SandholmICML 2023 · 16 citations
- Subgame Solving in Adversarial Team GamesBrian Hu Zhang, Luca Carminati, Federico Cacciamani, Gabriele Farina et al.NeurIPS 2022 · 10 citations
- Computing Optimal Nash Equilibria in Multiplayer GamesYouzhi Zhang, Bo An, Venkatramanan Siva SubrahmanianNeurIPS 2023 · 7 citations
Builds on4
- Computing Ex Ante Coordinated Team-Maxmin Equilibria in Zero-Sum Multiplayer Extensive-Form GamesYouzhi Zhang, Bo An, Jakub CernýAAAI 2021 · 30 citations
- Converging to Team-Maxmin Equilibria in Zero-Sum Multiplayer GamesYouzhi Zhang, Bo AnICML 2020 · 22 citations
- Computing Team-Maxmin Equilibria in Zero-Sum Multiplayer Extensive-Form GamesYouzhi Zhang, Bo AnAAAI 2020 · 21 citations
- Polynomial-Time Computation of Optimal Correlated Equilibria in Two-Player Extensive-Form Games with Public Chance Moves and BeyondGabriele Farina, Tuomas SandholmNeurIPS 2020 · 18 citations
Related papers
- DAG-Based Column Generation for Adversarial Team GamesYouzhi Zhang, Bo An, Daniel Dajun ZengICML 2024 · 6 citations
- Team Correlated Equilibria in Zero-Sum Extensive-Form Games via Tree DecompositionsBrian Hu Zhang, Tuomas SandholmAAAI 2022 · 26 citations
- Cooperative Multi-player Bandit OptimizationIlai Bistritz, Nicholas BambosNeurIPS 2020 · 31 citations
- Sample-Efficient Learning of Correlated Equilibria in Extensive-Form GamesZiang Song, Song Mei, Yu BaiNeurIPS 2022 · 11 citations
- Zero-Sum Games between Mean-Field Teams: Reachability-Based Analysis under Mean-Field SharingYue Guan, Mohammad Afshari, Panagiotis TsiotrasAAAI 2024 · 13 citations
