Efficient Online Pruning and Abstraction for Imperfect Information Extensive-Form Games
Boning Li, Longbo Huang
Abstract
Efficiently computing approximate equilibrium strategies in large Imperfect Information Extensive-Form Games (IIEFGs) poses significant challenges due to the game tree's exponential growth. While pruning and abstraction techniques are essential for complexity reduction, existing methods face two key limitations: (i) Seamless integration of pruning with Counterfactual Regret Minimization (CFR) is nontrivial, and (ii) Pruning and abstraction approaches incur prohibitive computational costs, hindering real-world deployment. We propose Expected-Value Pruning and Abstraction (EVPA), a novel online framework that addresses these challenges through three synergistic components: (i) Expected value estimation using approximate Nash equilibrium strategies to quantify information set utilities, (ii) Minimax pruning before CFR to eliminate a large number of sub-optimal actions permanently, and (iii) Dynamic online information abstraction merging information sets based on their current and future expected values in subgames. Experiments on Heads-up No-Limit Texas Hold'em (HUNL) show EVPA outperforms DeepStack's replication and Slumbot with significant win-rate margins in multiple settings. Remarkably, EVPA requires only 1%-2% of the solving time to reach an approximate Nash equilibrium compared to DeepStack's replication.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Efficient Last-Iterate Convergence in Solving Extensive-Form GamesLinjian Meng, Tianpei Yang, Youzhi Zhang, Zhenxing Ge et al.NeurIPS 2025 · 1 citation
- No-Regret Strategy Solving in Imperfect-Information Games via Pre-Trained EmbeddingYanchang Fu, Shengda Liu, Pei Xu, Kaiqi HuangAAAI 2026
Builds on5
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 205 citations
- AlphaHoldem: High-Performance Artificial Intelligence for Heads-Up No-Limit Poker via End-to-End Reinforcement LearningEnmin Zhao, Renye Yan, Jinqiu Li, Kai Li et al.AAAI 2022 · 63 citations
- Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and PlanningAnton Bakhtin, David J. Wu, Adam Lerer, Jonathan Gray et al.ICLR 2023 · 10 citations
- Dynamic Discounted Counterfactual Regret MinimizationHang Xu, Kai Li, Haobo Fu, Qiang Fu et al.ICLR 2024 · 7 citations
- RL-CFR: Improving Action Abstraction for Imperfect Information Extensive-Form Games with Reinforcement LearningBoning Li, Zhixuan Fang, Longbo HuangICML 2024 · 6 citations
Related papers
- Faster Game Solving via Asymmetry of Step SizesLinjian Meng, Tianpei Yang, Youzhi Zhang, Zhenxing Ge et al.AAAI 2026
- Don't Predict Counterfactual Values, Predict Expected Values InsteadJeremiasz Wolosiuk, Maciej Swiechowski, Jacek MandziukAAAI 2023 · 1 citation
- Model-Free Online Learning in Unknown Sequential Decision Making Problems and GamesGabriele Farina, Tuomas SandholmAAAI 2021 · 24 citations
- ESCHER: Eschewing Importance Sampling in Games by Computing a History Value Function to Estimate RegretStephen Marcus McAleer, Gabriele Farina, Marc Lanctot, Tuomas SandholmICLR 2023 · 1 citation
- An Efficient Deep Reinforcement Learning Algorithm for Solving Imperfect Information Extensive-Form GamesLinjian Meng, Zhenxing Ge, Pinzhuo Tian, Bo An et al.AAAI 2023 · 8 citations
