Abstracting Imperfect Information Away from Two-Player Zero-Sum Games
Samuel Sokota, Ryan D'Orazio, Chun Kai Ling, David J. Wu, J. Zico Kolter, Noam Brown
Abstract
In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equilibria of the game with public policy announcements may not correspond to Nash equilibria of the original game. As a consequence, existing sound decision-time planning algorithms require complicated additional mechanisms that have unappealing properties. The main contribution of this work is showing that certain regularized equilibria do not possess the aforementioned non-correspondence problem -- thus, computing them can be treated as perfect-information problems. Because these regularized equilibria can be made arbitrarily close to Nash equilibria, our result opens the door to a new perspective to solving two-player zero-sum games and yields a simplified framework for decision-time planning in two-player zero-sum games, void of the unappealing properties that plague existing decision-time planning approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext db9ff75e-b63e-4c30-8808-5c6511fb065dCited by top-tier papers4
- The Update-Equivalence Framework for Decision-Time PlanningSamuel Sokota, Gabriele Farina, David J. Wu, Hengyuan Hu et al.ICLR 2024 · 5 citations
- Look-ahead Reasoning with a Learned Model in Imperfect Information GamesOndrej Kubícek, Viliam LisýICLR 2026 · 3 citations
- Policy Gradient Methods Converge Globally in Imperfect-Information Extensive-Form GamesFivos Kalogiannis, Gabriele FarinaNeurIPS 2025 · 2 citations
- ε-Optimally Solving Two-Player Zero-Sum POSGsErwan Escudie, Matthia Sabatelli, Olivier Buffet, Jilles DibangoyeNeurIPS 2025 · 1 citation
Builds on11
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 205 citations
- Fast Policy Extragradient Methods for Competitive Games with Entropy RegularizationShicong Cen, Yuting Wei, Yuejie ChiNeurIPS 2021 · 105 citations
- From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via RegularizationJulien Pérolat, Rémi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei et al.ICML 2021 · 102 citations
- Improving Policies via Search in Cooperative Partially Observable GamesAdam Lerer, Hengyuan Hu, Jakob N. Foerster, Noam BrownAAAI 2020 · 87 citations
- Regularized Gradient Descent Ascent for Two-Player Zero-Sum Markov GamesSihan Zeng, Thinh T. Doan, Justin RombergNeurIPS 2022 · 27 citations
Related papers
- Fast computation of Nash Equilibria in Imperfect Information GamesRémi Munos, Julien Pérolat, Jean-Baptiste Lespiau, Mark Rowland et al.ICML 2020 · 11 citations
- Sample Efficient Stochastic Policy Extragradient Algorithm for Zero-Sum Markov GameZiyi Chen, Shaocong Ma, Yi ZhouICLR 2022 · 18 citations
- Learning in Zero-Sum Markov Games: Relaxing Strong Reachability and Mixing Time AssumptionsReda Ouhamma, Maryam KamgarpourAAAI 2026 · 2 citations
- A Policy-Gradient Approach to Solving Imperfect-Information Games with Best-Iterate ConvergenceMingyang Liu, Gabriele Farina, Asuman E. OzdaglarICLR 2025
- A Marriage between Adversarial Team Games and 2-player Games: Enabling Abstractions, No-regret Learning, and Subgame SolvingLuca Carminati, Federico Cacciamani, Marco Ciccone, Nicola GattiICML 2022 · 18 citations
