Computing Ex Ante Coordinated Team-Maxmin Equilibria in Zero-Sum Multiplayer Extensive-Form Games
Youzhi Zhang, Bo An, Jakub Cerný
Abstract
Computational game theory has many applications in the modern world in both adversarial situations and the optimization of social good. While there exist many algorithms for computing solutions in two-player interactions, finding optimal strategies in multiplayer interactions efficiently remains an open challenge. This paper focuses on computing the multiplayer Team-Maxmin Equilibrium with Coordination device (TMECor) in zero-sum extensive-form games. TMECor models scenarios when a team of players coordinates ex ante against an adversary. Such situations can be found in card games (e.g., in Bridge and Poker), when a team works together to beat a target player but communication is prohibited; and also in real world, e.g., in forest-protection operations, when coordinated groups have limited contact during interdicting illegal loggers. The existing algorithms struggle to find a TMECor efficiently because of their high computational costs. To compute a TMECor in larger games, we make the following key contributions: (1) we propose a hybrid-form strategy representation for the team, which preserves the set of equilibria; (2) we introduce a column-generation algorithm with a guaranteed finite-time convergence in the infinite strategy space based on a novel best-response oracle; (3) we develop an associated-representation technique for the exact representation of the multilinear terms in the best-response oracle; and (4) we experimentally show that our algorithm is several orders of magnitude faster than prior state-of-the-art algorithms in large games.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- Connecting Optimal Ex-Ante Collusion in Teams to Extensive-Form Correlation: Faster Algorithms and Positive Complexity ResultsGabriele Farina, Andrea Celli, Nicola Gatti, Tuomas SandholmICML 2021 · 29 citations
- Team Correlated Equilibria in Zero-Sum Extensive-Form Games via Tree DecompositionsBrian Hu Zhang, Tuomas SandholmAAAI 2022 · 26 citations
- A Marriage between Adversarial Team Games and 2-player Games: Enabling Abstractions, No-regret Learning, and Subgame SolvingLuca Carminati, Federico Cacciamani, Marco Ciccone, Nicola GattiICML 2022 · 18 citations
- Team-PSRO for Learning Approximate TMECor in Large Team Games via Cooperative Reinforcement LearningStephen McAleer, Gabriele Farina, Gaoyue Zhou, Mingzhi Wang et al.NeurIPS 2023 · 18 citations
- Team Belief DAG: Generalizing the Sequence Form to Team Games for Fast Computation of Correlated Team Max-Min Equilibria via Regret MinimizationBrian Hu Zhang, Gabriele Farina, Tuomas SandholmICML 2023 · 16 citations
Builds on2
Related papers
- DAG-Based Column Generation for Adversarial Team GamesYouzhi Zhang, Bo An, Daniel Dajun ZengICML 2024 · 6 citations
- Computing Optimal Nash Equilibria in Multiplayer GamesYouzhi Zhang, Bo An, Venkatramanan Siva SubrahmanianNeurIPS 2023 · 7 citations
- Efficiently Computing Nash Equilibria in Adversarial Team Markov GamesFivos Kalogiannis, Ioannis Anagnostides, Ioannis Panageas, Emmanouil V. Vlatakis-Gkaragkounis et al.ICLR 2023 · 2 citations
- Coarse Correlation in Extensive-Form GamesGabriele Farina, Tommaso Bianchi, Tuomas SandholmAAAI 2020 · 31 citations
- Subgame Solving in Adversarial Team GamesBrian Hu Zhang, Luca Carminati, Federico Cacciamani, Gabriele Farina et al.NeurIPS 2022 · 10 citations
