A Tight Lower Bound and Efficient Reduction for Swap Regret
Shinji Ito
Abstract
Swap regret, a generic performance measure of online decision-making algorithms, plays an important role in the theory of repeated games, along with a close connection to correlated equilibria in strategic games. This paper shows an ⌦( p T N log N )-lower bound for swap regret, where T and N denote the numbers of time steps and available actions, respectively. Our lower bound is tight up to a constant, and resolves an open problem mentioned, e.g., in the book by Nisan et al. [28]. Besides, we present a computationally efficient reduction method that converts no-external-regret algorithms to no-swap-regret algorithms. This method can be applied not only to the full-information setting but also to the bandit setting and provides a better regret bound than previous results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f89029d2-6986-4970-a297-7f6373ff3ef2Cited by top-tier papers11
- When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently?Ziang Song, Song Mei, Yu BaiICLR 2022 · 83 citations
- Near-optimal no-regret learning for correlated equilibria in multi-player general-sum gamesIoannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Maxwell Fishelson et al.STOC 2022 · 16 citations
- No Internal Regret with Non-convex Loss FunctionsDravyansh SharmaAAAI 2024 · 10 citations
- Efficient -Regret Minimization with Low-Degree Swap Deviations in Extensive-Form GamesBrian Hu Zhang, Ioannis Anagnostides, Gabriele Farina, Tuomas SandholmNeurIPS 2024 · 7 citations
- A Black-box Approach for Non-stationary Multi-agent Reinforcement LearningHaozhe Jiang, Qiwen Cui, Zhihan Xiong, Maryam Fazel et al.ICLR 2024 · 6 citations
Related papers
- Fast Swap Regret Minimization and Applications to Approximate Correlated EquilibriaBinghui Peng, Aviad RubinsteinSTOC 2024 · 2 citations
- From External to Swap Regret 2.0: An Efficient Reduction for Large Action SpacesYuval Dagan, Constantinos Daskalakis, Maxwell Fishelson, Noah GolowichSTOC 2024 · 2 citations
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 88 citations
- Regret Minimization and Convergence to Equilibria in General-sum Markov GamesLiad Erez, Tal Lancewicki, Uri Sherman, Tomer Koren et al.ICML 2023 · 35 citations
- Polynomial-Time Linear-Swap Regret Minimization in Imperfect-Information Sequential GamesGabriele Farina, Charilaos PipisNeurIPS 2023 · 13 citations
