Semi Bandit dynamics in Congestion Games: Convergence to Nash Equilibrium and No-Regret Guarantees
Ioannis Panageas, Stratis Skoulakis, Luca Viano, Xiao Wang, Volkan Cevher
Abstract
In this work, we introduce a new variant of online gradient descent, which provably converges to Nash Equilibria and simultaneously attains sublinear regret for the class of congestion games in the semi-bandit feedback setting. Our proposed method admits convergence rates depending only polynomially on the number of players and the number of facilities, but not on the size of the action set, which can be exponentially large in terms of the number of facilities. Moreover, the running time of our method has polynomial-time dependence on the implicit description of the game. As a result, our work answers an open question from (Du et. al, 2022).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dd1be9ff-29d4-4dbe-8055-c870b9d48ddeCited by top-tier papers4
- A Black-box Approach for Non-stationary Multi-agent Reinforcement LearningHaozhe Jiang, Qiwen Cui, Zhihan Xiong, Maryam Fazel et al.ICLR 2024 · 6 citations
- Convergence of Regret Matching in Potential Games and Constrained OptimizationIoannis Anagnostides, Emanuel Tewolde, Brian Hu Zhang, Ioannis Panageas et al.ICLR 2026 · 6 citations
- Learning Optimal Tax Design in Nonatomic Congestion GamesQiwen Cui, Maryam Fazel, Simon S. DuNeurIPS 2024 · 3 citations
- Efficient Kernelized Learning in Polyhedral Games beyond Full Information: From Colonel Blotto to Congestion GamesAndreas Kontogiannis, Vasilis Pollatos, Gabriele Farina, Panayotis Mertikopoulos et al.NeurIPS 2025 · 2 citations
Builds on8
- Global Convergence of Multi-Agent Policy Gradient in Markov Potential GamesStefanos Leonardos, Will Overman, Ioannis Panageas, Georgios PiliourasICLR 2022 · 158 citations
- No-Regret Learning and Mixed Nash Equilibria: They Do Not MixEmmanouil V. Vlatakis-Gkaragkounis, Lampros Flokas, Thanasis Lianeas, Panayotis Mertikopoulos et al.NeurIPS 2020 · 100 citations
- Independent Policy Gradient for Large-Scale Markov Potential Games: Sharper Rates, Function Approximation, and Game-Agnostic ConvergenceDongsheng Ding, Chen-Yu Wei, Kaiqing Zhang, Mihailo R. JovanovicICML 2022 · 84 citations
- On Last-Iterate Convergence Beyond Zero-Sum GamesIoannis Anagnostides, Ioannis Panageas, Gabriele Farina, Tuomas SandholmICML 2022 · 52 citations
- Learning in Congestion Games with Bandit FeedbackQiwen Cui, Zhihan Xiong, Maryam Fazel, Simon S. DuNeurIPS 2022 · 21 citations
Related papers
- Offline Congestion Games: How Feedback Type Affects Data Coverage RequirementHaozhe Jiang, Qiwen Cui, Zhihan Xiong, Maryam Fazel et al.ICLR 2023
- Settling the complexity of Nash equilibrium in congestion gamesYakov Babichenko, Aviad RubinsteinSTOC 2021 · 4 citations
- Online Performative Gradient Descent for Learning Nash Equilibria in Decision-Dependent GamesZihan Zhu, Ethan X. Fang, Zhuoran YangNeurIPS 2023 · 5 citations
- Gradient-free Online Learning in Continuous Games with Delayed RewardsAmélie Héliou, Panayotis Mertikopoulos, Zhengyuan ZhouICML 2020 · 31 citations
- Near-Optimal Learning of Extensive-Form Games with Imperfect InformationYu Bai, Chi Jin, Song Mei, Tiancheng YuICML 2022 · 31 citations
