Regret Bounds for Batched Bandits
Hossein Esfandiari, Amin Karbasi, Abbas Mehrabian, Vahab S. Mirrokni
2021年份
74被引次数
29顶会引用
摘要
We present simple algorithms for batched stochastic multi-armed bandit and batched stochastic linear bandit problems. We prove bounds for their expected regrets that improve and extend the best known regret bounds of Gao, Han, Ren, and Zhou (NeurIPS 2019), for any number of batches. In particular, our algorithms in both settings achieve the optimal expected regrets by using only a logarithmic number of batches. We also study the batched adversarial multi-armed bandit problem for the first time and provide the optimal regret, up to logarithmic factors, of any algorithm with predetermined batch sizes.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper29
- Provably Efficient Reinforcement Learning with Linear Function Approximation under Adaptivity ConstraintsTianhao Wang, Dongruo Zhou, Quanquan GuNeurIPS 2021 · 被引用 169 次
- Differentially Private Multi-Armed Bandits in the Shuffle ModelJay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri StemmerNeurIPS 2021 · 被引用 37 次
- Sample-Efficient Reinforcement Learning with loglog(T) Switching CostDan Qiao, Ming Yin, Ming Min, Yu-Xiang WangICML 2022 · 被引用 35 次
- Towards Deployment-Efficient Reinforcement Learning: Lower Bound and OptimalityJiawei Huang, Jinglin Chen, Li Zhao, Tao Qin 等ICLR 2022 · 被引用 32 次
- Batched Thompson SamplingCem Kalkanli, Ayfer ÖzgürNeurIPS 2021 · 被引用 29 次
相关 Paper
- Almost Optimal Anytime Algorithm for Batched Multi-Armed BanditsTianyuan Jin, Jing Tang, Pan Xu, Keke Huang 等ICML 2021 · 被引用 25 次
- Optimal and Practical Batched Linear Bandit AlgorithmSanghoon Yu, Min-hwan OhICML 2025
- Almost Optimal Batch-Regret Tradeoff for Batch Linear Contextual BanditsZihan Zhang, Xiangyang Ji, Yuan ZhouICLR 2025
- Optimal Batched Linear BanditsXuanfei Ren, Tianyuan Jin, Pan XuICML 2024 · 被引用 6 次
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 被引用 2 次
