History Filtering in Imperfect Information Games: Algorithms and Complexity
Christopher Solinas, Douglas Rebstock, Nathan R. Sturtevant, Michael Buro
摘要
Historically applied exclusively to perfect information games, depth-limited search with value functions has been key to recent advances in AI for imperfect information games. Most prominent approaches with strong theoretical guarantees require subgame decomposition - a process in which a subgame is computed from public information and player beliefs. However, subgame decomposition can itself require non-trivial computations, and its tractability depends on the existence of efficient algorithms for either full enumeration or generation of the histories that form the root of the subgame. Despite this, no formal analysis of the tractability of such computations has been established in prior work, and application domains have often consisted of games, such as poker, for which enumeration is trivial on modern hardware. Applying these ideas to more complex domains requires understanding their cost. In this work, we introduce and analyze the computational aspects and tractability of filtering histories for subgame decomposition. We show that constructing a single history from the root of the subgame is generally intractable, and then provide a necessary and sufficient condition for efficient enumeration. We also introduce a novel Markov Chain Monte Carlo-based generation algorithm for trick-taking card games - a domain where enumeration is often prohibitively expensive. Our experiments demonstrate its improved scalability in the trick-taking card game Oh Hell. These contributions clarify when and how depth-limited search via subgame decomposition can be an effective tool for sequential decision-making in imperfect information settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper3
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 被引用 205 次
- Scalable Online Planning via Reinforcement Learning Fine-TuningArnaud Fickinger, Hengyuan Hu, Brandon Amos, Stuart J. Russell 等NeurIPS 2021 · 被引用 26 次
- A Fine-Tuning Approach to Belief State ModelingSamuel Sokota, Hengyuan Hu, David J. Wu, J. Zico Kolter 等ICLR 2022 · 被引用 13 次
相关 Paper
- Subgame solving without common knowledgeBrian Hu Zhang, Tuomas SandholmNeurIPS 2021 · 被引用 21 次
- Opponent-Limited Online Search for Imperfect Information GamesWeiming Liu, Haobo Fu, Qiang Fu, Wei YangICML 2023 · 被引用 7 次
- Efficient Subgame Refinement for Extensive-form GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Wenbin Li 等NeurIPS 2023 · 被引用 2 次
- Efficient Online Pruning and Abstraction for Imperfect Information Extensive-Form GamesBoning Li, Longbo HuangICLR 2025
- Submodel Decomposition Bounds for Influence DiagramsJunkyu Lee, Radu Marinescu, Rina DechterAAAI 2021 · 被引用 5 次
