Better Best of Both Worlds Bounds for Bandits with Switching Costs
Idan Amir, Guy Azov, Tomer Koren, Roi Livni
摘要
We study best-of-both-worlds algorithms for bandits with switching cost, recently addressed by Rouyer, Seldin and Cesa-Bianchi, 2021. We introduce a surprisingly simple and effective algorithm that simultaneously achieves minimax optimal regret bound of in the oblivious adversarial setting and a bound of in the stochastically-constrained regime, both with (unit) switching costs, where is the gap between the arms. In the stochastically constrained case, our bound improves over previous results due to Rouyer et al., that achieved regret of . We accompany our results with a lower bound showing that, in general, regret is unavoidable in the stochastically-constrained case for algorithms with worst-case regret.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback GraphsShinji Ito, Taira Tsuchiya, Junya HondaNeurIPS 2022 · 被引用 29 次
- Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal ArmsTiancheng Jin, Junyan Liu, Haipeng LuoNeurIPS 2023 · 被引用 24 次
- Best of Both Worlds Policy OptimizationChristoph Dann, Chen-Yu Wei, Julian ZimmertICML 2023 · 被引用 17 次
- Constrained Bandit Learning with Switching Costs for Wireless NetworksJuaren Steiger, Bin Li, Bo Ji, Ning LuINFOCOM 2023 · 被引用 13 次
- An Exploration-by-Optimization Approach to Best of Both Worlds in Linear BanditsShinji Ito, Kei TakemuraNeurIPS 2023 · 被引用 7 次
它引用的顶会 Paper2
相关 Paper
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 被引用 2 次
- Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial ConstraintsMartino Bernasconi, Matteo Castiglioni, Andrea Celli, Federico FuscoNeurIPS 2024 · 被引用 12 次
- Understanding the Role of Feedback in Online Learning with Switching CostsDuo Cheng, Xingyu Zhou, Bo JiICML 2023 · 被引用 6 次
- Follow-the-Perturbed-Leader for Decoupled Bandits: Best-of-Both-Worlds and PracticalityChaiwon Kim, Jongyeong Lee, Min-hwan OhICML 2026
- Near-Optimal Adversarial Reinforcement Learning with Switching CostsMing Shi, Yingbin Liang, Ness B. ShroffICLR 2023
