A Tight Lower Bound and Efficient Reduction for Swap Regret
Shinji Ito
摘要
Swap regret, a generic performance measure of online decision-making algorithms, plays an important role in the theory of repeated games, along with a close connection to correlated equilibria in strategic games. This paper shows an ⌦( p T N log N )-lower bound for swap regret, where T and N denote the numbers of time steps and available actions, respectively. Our lower bound is tight up to a constant, and resolves an open problem mentioned, e.g., in the book by Nisan et al. [28]. Besides, we present a computationally efficient reduction method that converts no-external-regret algorithms to no-swap-regret algorithms. This method can be applied not only to the full-information setting but also to the bandit setting and provides a better regret bound than previous results.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently?Ziang Song, Song Mei, Yu BaiICLR 2022 · 被引用 83 次
- Near-optimal no-regret learning for correlated equilibria in multi-player general-sum gamesIoannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Maxwell Fishelson 等STOC 2022 · 被引用 16 次
- No Internal Regret with Non-convex Loss FunctionsDravyansh SharmaAAAI 2024 · 被引用 10 次
- Efficient -Regret Minimization with Low-Degree Swap Deviations in Extensive-Form GamesBrian Hu Zhang, Ioannis Anagnostides, Gabriele Farina, Tuomas SandholmNeurIPS 2024 · 被引用 7 次
- A Black-box Approach for Non-stationary Multi-agent Reinforcement LearningHaozhe Jiang, Qiwen Cui, Zhihan Xiong, Maryam Fazel 等ICLR 2024 · 被引用 6 次
相关 Paper
- Fast Swap Regret Minimization and Applications to Approximate Correlated EquilibriaBinghui Peng, Aviad RubinsteinSTOC 2024 · 被引用 2 次
- From External to Swap Regret 2.0: An Efficient Reduction for Large Action SpacesYuval Dagan, Constantinos Daskalakis, Maxwell Fishelson, Noah GolowichSTOC 2024 · 被引用 2 次
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 被引用 88 次
- Regret Minimization and Convergence to Equilibria in General-sum Markov GamesLiad Erez, Tal Lancewicki, Uri Sherman, Tomer Koren 等ICML 2023 · 被引用 35 次
- Polynomial-Time Linear-Swap Regret Minimization in Imperfect-Information Sequential GamesGabriele Farina, Charilaos PipisNeurIPS 2023 · 被引用 13 次
