Abstracting Imperfect Information Away from Two-Player Zero-Sum Games
Samuel Sokota, Ryan D'Orazio, Chun Kai Ling, David J. Wu, J. Zico Kolter, Noam Brown
摘要
In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equilibria of the game with public policy announcements may not correspond to Nash equilibria of the original game. As a consequence, existing sound decision-time planning algorithms require complicated additional mechanisms that have unappealing properties. The main contribution of this work is showing that certain regularized equilibria do not possess the aforementioned non-correspondence problem -- thus, computing them can be treated as perfect-information problems. Because these regularized equilibria can be made arbitrarily close to Nash equilibria, our result opens the door to a new perspective to solving two-player zero-sum games and yields a simplified framework for decision-time planning in two-player zero-sum games, void of the unappealing properties that plague existing decision-time planning approaches.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- The Update-Equivalence Framework for Decision-Time PlanningSamuel Sokota, Gabriele Farina, David J. Wu, Hengyuan Hu 等ICLR 2024 · 被引用 5 次
- Look-ahead Reasoning with a Learned Model in Imperfect Information GamesOndrej Kubícek, Viliam LisýICLR 2026 · 被引用 3 次
- Policy Gradient Methods Converge Globally in Imperfect-Information Extensive-Form GamesFivos Kalogiannis, Gabriele FarinaNeurIPS 2025 · 被引用 2 次
- ε-Optimally Solving Two-Player Zero-Sum POSGsErwan Escudie, Matthia Sabatelli, Olivier Buffet, Jilles DibangoyeNeurIPS 2025 · 被引用 1 次
它引用的顶会 Paper11
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 被引用 205 次
- Fast Policy Extragradient Methods for Competitive Games with Entropy RegularizationShicong Cen, Yuting Wei, Yuejie ChiNeurIPS 2021 · 被引用 105 次
- From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via RegularizationJulien Pérolat, Rémi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei 等ICML 2021 · 被引用 102 次
- Improving Policies via Search in Cooperative Partially Observable GamesAdam Lerer, Hengyuan Hu, Jakob N. Foerster, Noam BrownAAAI 2020 · 被引用 87 次
- Regularized Gradient Descent Ascent for Two-Player Zero-Sum Markov GamesSihan Zeng, Thinh T. Doan, Justin RombergNeurIPS 2022 · 被引用 27 次
相关 Paper
- Fast computation of Nash Equilibria in Imperfect Information GamesRémi Munos, Julien Pérolat, Jean-Baptiste Lespiau, Mark Rowland 等ICML 2020 · 被引用 11 次
- Sample Efficient Stochastic Policy Extragradient Algorithm for Zero-Sum Markov GameZiyi Chen, Shaocong Ma, Yi ZhouICLR 2022 · 被引用 18 次
- Learning in Zero-Sum Markov Games: Relaxing Strong Reachability and Mixing Time AssumptionsReda Ouhamma, Maryam KamgarpourAAAI 2026 · 被引用 2 次
- A Policy-Gradient Approach to Solving Imperfect-Information Games with Best-Iterate ConvergenceMingyang Liu, Gabriele Farina, Asuman E. OzdaglarICLR 2025
- A Marriage between Adversarial Team Games and 2-player Games: Enabling Abstractions, No-regret Learning, and Subgame SolvingLuca Carminati, Federico Cacciamani, Marco Ciccone, Nicola GattiICML 2022 · 被引用 18 次
