Opponent-Limited Online Search for Imperfect Information Games
Weiming Liu, Haobo Fu, Qiang Fu, Wei Yang
摘要
In recent years, online search has been playing an increasingly important role in imperfect information games (IIGs). Previous online search is known as common-knowledge subgame solving, which has to consider all the states in a common-knowledge closure. This is only computationally tolerable for medium size games, such as poker. To handle larger games, order-1 Knowledge-Limited Subgame Solving (1-KLSS) only considers the states in a knowledge-limited closure, which results in a much smaller subgame. However, 1-KLSS is unsafe. In this paper, we first extend 1-KLSS to Safe-1-KLSS and prove its safeness. To make Safe-1-KLSS applicable to even larger games, we propose Opponent-Limited Subgame Solving (OLSS) to limit how the opponent reaches a subgame and how it acts in the subgame. Limiting the opponent's strategy dramatically reduces the subgame size and improves the efficiency of subgame solving while still preserving some safety in the limit. Experiments in medium size poker show that Safe-1-KLSS and OLSS are orders of magnitude faster than previous common-knowledge subgame solving. Also, OLSS significantly improves the online performance in a two-player Mahjong game, whose game size prohibits the use of previous commonknowledge subgame-solving methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- Policy Space Diversity for Non-Transitive GamesJian Yao, Weiming Liu, Haobo Fu, Yaodong Yang 等NeurIPS 2023 · 被引用 28 次
- General search techniques without common knowledge for imperfect-information games, and application to superhuman Fog of War chessBrian Zhang, Tuomas SandholmICLR 2026 · 被引用 13 次
- Opponent Modeling with In-context SearchYuheng Jing, Bingyun Liu, Kai Li, Yifan Zang 等NeurIPS 2024 · 被引用 8 次
- Towards Offline Opponent Modeling with In-context LearningYuheng Jing, Kai Li, Bingyun Liu, Yifan Zang 等ICLR 2024 · 被引用 7 次
- The Update-Equivalence Framework for Decision-Time PlanningSamuel Sokota, Gabriele Farina, David J. Wu, Hengyuan Hu 等ICLR 2024 · 被引用 5 次
它引用的顶会 Paper3
- Actor-Critic Policy Optimization in a Large-Scale Imperfect-Information GameHaobo Fu, Weiming Liu, Shuang Wu, Yijia Wang 等ICLR 2022 · 被引用 32 次
- Subgame solving without common knowledgeBrian Hu Zhang, Tuomas SandholmNeurIPS 2021 · 被引用 21 次
- Greedy when Sure and Conservative when Uncertain about the OpponentsHaobo Fu, Ye Tian, Hongxiang Yu, Weiming Liu 等ICML 2022 · 被引用 12 次
相关 Paper
- Efficient Subgame Refinement for Extensive-form GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Wenbin Li 等NeurIPS 2023 · 被引用 2 次
- History Filtering in Imperfect Information Games: Algorithms and ComplexityChristopher Solinas, Douglas Rebstock, Nathan R. Sturtevant, Michael BuroNeurIPS 2023 · 被引用 3 次
- Opponent-Model Search in Games with Incomplete InformationJunkang Li, Bruno Zanuttini, Véronique VentosAAAI 2024 · 被引用 1 次
- Safe and Robust Subgame Exploitation in Imperfect Information GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng 等ICML 2024 · 被引用 3 次
- Game Solving with Online Fine-TuningTi-Rong Wu, Hung Guei, Ting-Han Wei, Chung-Chin Shih 等NeurIPS 2023 · 被引用 3 次
