Efficient Online Pruning and Abstraction for Imperfect Information Extensive-Form Games
Boning Li, Longbo Huang
摘要
Efficiently computing approximate equilibrium strategies in large Imperfect Information Extensive-Form Games (IIEFGs) poses significant challenges due to the game tree's exponential growth. While pruning and abstraction techniques are essential for complexity reduction, existing methods face two key limitations: (i) Seamless integration of pruning with Counterfactual Regret Minimization (CFR) is nontrivial, and (ii) Pruning and abstraction approaches incur prohibitive computational costs, hindering real-world deployment. We propose Expected-Value Pruning and Abstraction (EVPA), a novel online framework that addresses these challenges through three synergistic components: (i) Expected value estimation using approximate Nash equilibrium strategies to quantify information set utilities, (ii) Minimax pruning before CFR to eliminate a large number of sub-optimal actions permanently, and (iii) Dynamic online information abstraction merging information sets based on their current and future expected values in subgames. Experiments on Heads-up No-Limit Texas Hold'em (HUNL) show EVPA outperforms DeepStack's replication and Slumbot with significant win-rate margins in multiple settings. Remarkably, EVPA requires only 1%-2% of the solving time to reach an approximate Nash equilibrium compared to DeepStack's replication.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Efficient Last-Iterate Convergence in Solving Extensive-Form GamesLinjian Meng, Tianpei Yang, Youzhi Zhang, Zhenxing Ge 等NeurIPS 2025 · 被引用 1 次
- No-Regret Strategy Solving in Imperfect-Information Games via Pre-Trained EmbeddingYanchang Fu, Shengda Liu, Pei Xu, Kaiqi HuangAAAI 2026
它引用的顶会 Paper5
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 被引用 205 次
- AlphaHoldem: High-Performance Artificial Intelligence for Heads-Up No-Limit Poker via End-to-End Reinforcement LearningEnmin Zhao, Renye Yan, Jinqiu Li, Kai Li 等AAAI 2022 · 被引用 63 次
- Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and PlanningAnton Bakhtin, David J. Wu, Adam Lerer, Jonathan Gray 等ICLR 2023 · 被引用 10 次
- Dynamic Discounted Counterfactual Regret MinimizationHang Xu, Kai Li, Haobo Fu, Qiang Fu 等ICLR 2024 · 被引用 7 次
- RL-CFR: Improving Action Abstraction for Imperfect Information Extensive-Form Games with Reinforcement LearningBoning Li, Zhixuan Fang, Longbo HuangICML 2024 · 被引用 6 次
相关 Paper
- Faster Game Solving via Asymmetry of Step SizesLinjian Meng, Tianpei Yang, Youzhi Zhang, Zhenxing Ge 等AAAI 2026
- Don't Predict Counterfactual Values, Predict Expected Values InsteadJeremiasz Wolosiuk, Maciej Swiechowski, Jacek MandziukAAAI 2023 · 被引用 1 次
- Model-Free Online Learning in Unknown Sequential Decision Making Problems and GamesGabriele Farina, Tuomas SandholmAAAI 2021 · 被引用 24 次
- ESCHER: Eschewing Importance Sampling in Games by Computing a History Value Function to Estimate RegretStephen Marcus McAleer, Gabriele Farina, Marc Lanctot, Tuomas SandholmICLR 2023 · 被引用 1 次
- An Efficient Deep Reinforcement Learning Algorithm for Solving Imperfect Information Extensive-Form GamesLinjian Meng, Zhenxing Ge, Pinzhuo Tian, Bo An 等AAAI 2023 · 被引用 8 次
