Faster Algorithm for Turn-based Stochastic Games with Bounded Treewidth
Krishnendu Chatterjee, Tobias Meggendorfer, Raimundo Saona, Jakub Svoboda
Abstract
Turn-based stochastic games (aka simple stochastic games) are two-player zero-sum games played on directed graphs with probabilistic transitions. The goal of player-max is to maximize the probability to reach a target state against the adversarial player-min. These games lie in NP ∩ coNP and are among the rare combinatorial problems that belong to this complexity class for which the existence of polynomial-time algorithm is a major open question. While randomized sub-exponential time algorithm exists, all known deterministic algorithms require exponential time in the worst-case. An important open question has been whether faster algorithms can be obtained parametrized by the treewidth of the game graph. Even deterministic sub-exponential time algorithm for constant treewidth turn-based stochastic games has remain elusive. In this work our main result is a deterministic algorithm to solve turn-based stochastic games that, given a game with n states, treewidth at most t, and the bit-complexity of the probabilistic transition function log D, has running time O ((tn2 log D)t log n). In particular, our algorithm is quasi-polynomial time for games with constant or poly-logarithmic treewidth.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 54407813-135d-4df2-a129-37ab0e2025b6Cited by top-tier papers3
- Stopping Criteria for Value Iteration on Stochastic Games with Quantitative ObjectivesJan Kretínský, Tobias Meggendorfer, Maximilian WeiningerLICS 2023 · 10 citations
- Linear Equations with Min and Max Operators: Computational ComplexityKrishnendu Chatterjee, Ruichen Luo, Raimundo Saona, Jakub SvobodaAAAI 2025
- Reinforcement Learning for Reachability: Guaranteeing Asymptotic OptimalityAmogh Palasamudram, Jakub Svoboda, Suguman Bansal, Krishnendu ChatterjeeICML 2026
Related papers
- Deterministic Sub-exponential Algorithm for Discounted-sum Games with Unary WeightsAli Asadi, Krishnendu Chatterjee, Jakub Svoboda, Raimundo Saona UrmenetaLICS 2024 · 1 citation
- Approximating Values of Generalized-Reachability Stochastic GamesPranav Ashok, Krishnendu Chatterjee, Jan Kretínský, Maximilian Weininger et al.LICS 2020 · 10 citations
- Stochastic Games with Lexicographic Reachability-Safety ObjectivesKrishnendu Chatterjee, Joost-Pieter Katoen, Maximilian Weininger, Tobias WinklerCAV 2020 · 20 citations
- Polyhedral Value Iteration for Discounted Games and Energy GamesAlexander KozachinskiySODA 2021 · 2 citations
- One-Clock Priced Timed Games are PSPACE-hardJohn Fearnley, Rasmus Ibsen-Jensen, Rahul SavaniLICS 2020 · 1 citation
