History Filtering in Imperfect Information Games: Algorithms and Complexity
Christopher Solinas, Douglas Rebstock, Nathan R. Sturtevant, Michael Buro
Abstract
Historically applied exclusively to perfect information games, depth-limited search with value functions has been key to recent advances in AI for imperfect information games. Most prominent approaches with strong theoretical guarantees require subgame decomposition - a process in which a subgame is computed from public information and player beliefs. However, subgame decomposition can itself require non-trivial computations, and its tractability depends on the existence of efficient algorithms for either full enumeration or generation of the histories that form the root of the subgame. Despite this, no formal analysis of the tractability of such computations has been established in prior work, and application domains have often consisted of games, such as poker, for which enumeration is trivial on modern hardware. Applying these ideas to more complex domains requires understanding their cost. In this work, we introduce and analyze the computational aspects and tractability of filtering histories for subgame decomposition. We show that constructing a single history from the root of the subgame is generally intractable, and then provide a necessary and sufficient condition for efficient enumeration. We also introduce a novel Markov Chain Monte Carlo-based generation algorithm for trick-taking card games - a domain where enumeration is often prohibitively expensive. Our experiments demonstrate its improved scalability in the trick-taking card game Oh Hell. These contributions clarify when and how depth-limited search via subgame decomposition can be an effective tool for sequential decision-making in imperfect information settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e0a87d79-d4cf-4026-b34f-75f6795a1e06Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 205 citations
- Scalable Online Planning via Reinforcement Learning Fine-TuningArnaud Fickinger, Hengyuan Hu, Brandon Amos, Stuart J. Russell et al.NeurIPS 2021 · 26 citations
- A Fine-Tuning Approach to Belief State ModelingSamuel Sokota, Hengyuan Hu, David J. Wu, J. Zico Kolter et al.ICLR 2022 · 13 citations
Related papers
- Subgame solving without common knowledgeBrian Hu Zhang, Tuomas SandholmNeurIPS 2021 · 21 citations
- Opponent-Limited Online Search for Imperfect Information GamesWeiming Liu, Haobo Fu, Qiang Fu, Wei YangICML 2023 · 7 citations
- Efficient Subgame Refinement for Extensive-form GamesZhenxing Ge, Zheng Xu, Tianyu Ding, Wenbin Li et al.NeurIPS 2023 · 2 citations
- Efficient Online Pruning and Abstraction for Imperfect Information Extensive-Form GamesBoning Li, Longbo HuangICLR 2025
- Submodel Decomposition Bounds for Influence DiagramsJunkyu Lee, Radu Marinescu, Rina DechterAAAI 2021 · 5 citations
