Opponent-Limited Online Search for Imperfect Information Games
Weiming Liu, Haobo Fu, Qiang Fu, Wei Yang
Abstract
In recent years, online search has been playing an increasingly important role in imperfect information games (IIGs). Previous online search is known as common-knowledge subgame solving, which has to consider all the states in a common-knowledge closure. This is only computationally tolerable for medium size games, such as poker. To handle larger games, order-1 Knowledge-Limited Subgame Solving (1-KLSS) only considers the states in a knowledge-limited closure, which results in a much smaller subgame. However, 1-KLSS is unsafe. In this paper, we first extend 1-KLSS to Safe-1-KLSS and prove its safeness. To make Safe-1-KLSS applicable to even larger games, we propose Opponent-Limited Subgame Solving (OLSS) to limit how the opponent reaches a subgame and how it acts in the subgame. Limiting the opponent's strategy dramatically reduces the subgame size and improves the efficiency of subgame solving while still preserving some safety in the limit. Experiments in medium size poker show that Safe-1-KLSS and OLSS are orders of magnitude faster than previous common-knowledge subgame solving. Also, OLSS significantly improves the online performance in a two-player Mahjong game, whose game size prohibits the use of previous commonknowledge subgame-solving methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5c361733-8bb9-4f5c-b7ef-c73587c5fa7fCited by top-tier papers7
- Policy Space Diversity for Non-Transitive GamesJian Yao, Weiming Liu, Haobo Fu, Yaodong Yang et al.NeurIPS 2023 · 28 citations
- General search techniques without common knowledge for imperfect-information games, and application to superhuman Fog of War chessBrian Zhang, Tuomas SandholmICLR 2026 · 13 citations
- Opponent Modeling with In-context SearchYuheng Jing, Bingyun Liu, Kai Li, Yifan Zang et al.NeurIPS 2024 · 8 citations
- Towards Offline Opponent Modeling with In-context LearningYuheng Jing, Kai Li, Bingyun Liu, Yifan Zang et al.ICLR 2024 · 7 citations
- The Update-Equivalence Framework for Decision-Time PlanningSamuel Sokota, Gabriele Farina, David J. Wu, Hengyuan Hu et al.ICLR 2024 · 5 citations
Builds on3
- Actor-Critic Policy Optimization in a Large-Scale Imperfect-Information GameHaobo Fu, Weiming Liu, Shuang Wu, Yijia Wang et al.ICLR 2022 · 32 citations
- Subgame solving without common knowledgeBrian Hu Zhang, Tuomas SandholmNeurIPS 2021 · 21 citations
- Greedy when Sure and Conservative when Uncertain about the OpponentsHaobo Fu, Ye Tian, Hongxiang Yu, Weiming Liu et al.ICML 2022 · 12 citations
Related papers
- Efficient Subgame Refinement for Extensive-form GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Wenbin Li et al.NeurIPS 2023 · 2 citations
- History Filtering in Imperfect Information Games: Algorithms and ComplexityChristopher Solinas, Douglas Rebstock, Nathan R. Sturtevant, Michael BuroNeurIPS 2023 · 3 citations
- Opponent-Model Search in Games with Incomplete InformationJunkang Li, Bruno Zanuttini, Véronique VentosAAAI 2024 · 1 citation
- Safe and Robust Subgame Exploitation in Imperfect Information GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng et al.ICML 2024 · 3 citations
- Game Solving with Online Fine-TuningTi-Rong Wu, Hung Guei, Ting-Han Wei, Chung-Chin Shih et al.NeurIPS 2023 · 3 citations
