Better Best of Both Worlds Bounds for Bandits with Switching Costs
Idan Amir, Guy Azov, Tomer Koren, Roi Livni
Abstract
We study best-of-both-worlds algorithms for bandits with switching cost, recently addressed by Rouyer, Seldin and Cesa-Bianchi, 2021. We introduce a surprisingly simple and effective algorithm that simultaneously achieves minimax optimal regret bound of in the oblivious adversarial setting and a bound of in the stochastically-constrained regime, both with (unit) switching costs, where is the gap between the arms. In the stochastically constrained case, our bound improves over previous results due to Rouyer et al., that achieved regret of . We accompany our results with a lower bound showing that, in general, regret is unavoidable in the stochastically-constrained case for algorithms with worst-case regret.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9b88fec3-6be0-4d1b-a1fb-52535905ca08Cited by top-tier papers10
- Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback GraphsShinji Ito, Taira Tsuchiya, Junya HondaNeurIPS 2022 · 29 citations
- Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal ArmsTiancheng Jin, Junyan Liu, Haipeng LuoNeurIPS 2023 · 24 citations
- Best of Both Worlds Policy OptimizationChristoph Dann, Chen-Yu Wei, Julian ZimmertICML 2023 · 17 citations
- Constrained Bandit Learning with Switching Costs for Wireless NetworksJuaren Steiger, Bin Li, Bo Ji, Ning LuINFOCOM 2023 · 13 citations
- An Exploration-by-Optimization Approach to Best of Both Worlds in Linear BanditsShinji Ito, Kei TakemuraNeurIPS 2023 · 7 citations
Builds on2
Related papers
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 2 citations
- Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial ConstraintsMartino Bernasconi, Matteo Castiglioni, Andrea Celli, Federico FuscoNeurIPS 2024 · 12 citations
- Understanding the Role of Feedback in Online Learning with Switching CostsDuo Cheng, Xingyu Zhou, Bo JiICML 2023 · 6 citations
- Follow-the-Perturbed-Leader for Decoupled Bandits: Best-of-Both-Worlds and PracticalityChaiwon Kim, Jongyeong Lee, Min-hwan OhICML 2026
- Near-Optimal Adversarial Reinforcement Learning with Switching CostsMing Shi, Yingbin Liang, Ness B. ShroffICLR 2023
