Securing Equal Share: A Principled Approach for Learning Multiplayer Symmetric Games
Jiawei Ge, Yuanhao Wang, Wenzhe Li, Chi Jin
Abstract
This paper examines multiplayer symmetric constant-sum games with more than two players in a competitive setting, including examples like Mahjong, Poker, and various board and video games. In contrast to two-player zero-sum games, equilibria in multiplayer games are neither unique nor non-exploitable, failing to provide meaningful guarantees when competing against opponents who play different equilibria or non-equilibrium strategies. This gives rise to a series of long-lasting fundamental questions in multiplayer games regarding suitable objectives, solution concepts, and principled algorithms. This paper takes an initial step towards addressing these challenges by focusing on the natural objective of equal share -- securing an expected payoff of C/n in an n-player symmetric game with a total payoff of C. We rigorously identify the theoretical conditions under which achieving an equal share is tractable and design a series of efficient algorithms, inspired by no-regret learning, that provably attain approximate equal share across various settings. Furthermore, we provide complementary lower bounds that justify the sharpness of our theoretical results. Our experimental results highlight worst-case scenarios where meta-algorithms from prior state-of-the-art systems for multiplayer games fail to secure an equal share, while our algorithm succeeds, demonstrating the effectiveness of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- Towards Playing Full MOBA Games with Deep Reinforcement LearningDeheng Ye, Guibin Chen, Wen Zhang, Sheng Chen et al.NeurIPS 2020 · 225 citations
- Linear Last-iterate Convergence in Constrained Saddle-point OptimizationChen-Yu Wei, Chung-Wei Lee, Mengxiao Zhang, Haipeng LuoICLR 2021 · 146 citations
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 141 citations
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 88 citations
- Modeling Strong and Human-Like Gameplay with KL-Regularized SearchAthul Paul Jacob, David J. Wu, Gabriele Farina, Adam Lerer et al.ICML 2022 · 69 citations
Related papers
- Guarantees for Self-Play in Multiplayer Games via Polymatrix DecomposabilityRevan MacQueen, James R. WrightNeurIPS 2023 · 4 citations
- Sampling Equilibria: Fast No-Regret Learning in Structured GamesDaniel Beaglehole, Max Hopkins, Daniel Kane, Sihan Liu et al.SODA 2023 · 2 citations
- Learning Markov Games with Adversarial Opponents: Efficient Algorithms and Fundamental LimitsQinghua Liu, Yuanhao Wang, Chi JinICML 2022 · 18 citations
- Multi-Agent Meta-Reinforcement Learning: Sharper Convergence Rates with Task SimilarityWeichao Mao, Haoran Qiu, Chen Wang, Hubertus Franke et al.NeurIPS 2023 · 17 citations
- Competing for Shareable Arms in Multi-Player Multi-Armed BanditsRenzhe Xu, Haotian Wang, Xingxuan Zhang, Bo Li et al.ICML 2023 · 10 citations
