Lune

NeurIPS2022Top-tier venue

Better Best of Both Worlds Bounds for Bandits with Switching Costs

Idan Amir, Guy Azov, Tomer Koren, Roi Livni

2022Year
21Citations
10Top-tier citations

Abstract

We study best-of-both-worlds algorithms for bandits with switching cost, recently addressed by Rouyer, Seldin and Cesa-Bianchi, 2021. We introduce a surprisingly simple and effective algorithm that simultaneously achieves minimax optimal regret bound of O(T2/3)\mathcal{O}(T^{2/3}) in the oblivious adversarial setting and a bound of O(min⁡{log⁡(T)/Δ2,T2/3})\mathcal{O}(\min\{\log (T)/\Delta^2,T^{2/3}\}) in the stochastically-constrained regime, both with (unit) switching costs, where Δ\Delta is the gap between the arms. In the stochastically constrained case, our bound improves over previous results due to Rouyer et al., that achieved regret of O(T1/3/Δ)\mathcal{O}(T^{1/3}/\Delta). We accompany our results with a lower bound showing that, in general, Ω~(min⁡{1/Δ2,T2/3})\tilde{\Omega}(\min\{1/\Delta^2,T^{2/3}\}) regret is unavoidable in the stochastically-constrained case for algorithms with O(T2/3)\mathcal{O}(T^{2/3}) worst-case regret.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 9b88fec3-6be0-4d1b-a1fb-52535905ca08

Cited by top-tier papers10

Ask how each one uses it

Builds on2

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines