Regret Bounds for Batched Bandits
Hossein Esfandiari, Amin Karbasi, Abbas Mehrabian, Vahab S. Mirrokni
Abstract
We present simple algorithms for batched stochastic multi-armed bandit and batched stochastic linear bandit problems. We prove bounds for their expected regrets that improve and extend the best known regret bounds of Gao, Han, Ren, and Zhou (NeurIPS 2019), for any number of batches. In particular, our algorithms in both settings achieve the optimal expected regrets by using only a logarithmic number of batches. We also study the batched adversarial multi-armed bandit problem for the first time and provide the optimal regret, up to logarithmic factors, of any algorithm with predetermined batch sizes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7ffcdf20-0ce5-4318-9cf3-1476d132a244Cited by top-tier papers29
- Provably Efficient Reinforcement Learning with Linear Function Approximation under Adaptivity ConstraintsTianhao Wang, Dongruo Zhou, Quanquan GuNeurIPS 2021 · 169 citations
- Differentially Private Multi-Armed Bandits in the Shuffle ModelJay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri StemmerNeurIPS 2021 · 37 citations
- Sample-Efficient Reinforcement Learning with loglog(T) Switching CostDan Qiao, Ming Yin, Ming Min, Yu-Xiang WangICML 2022 · 35 citations
- Towards Deployment-Efficient Reinforcement Learning: Lower Bound and OptimalityJiawei Huang, Jinglin Chen, Li Zhao, Tao Qin et al.ICLR 2022 · 32 citations
- Batched Thompson SamplingCem Kalkanli, Ayfer ÖzgürNeurIPS 2021 · 29 citations
Related papers
- Almost Optimal Anytime Algorithm for Batched Multi-Armed BanditsTianyuan Jin, Jing Tang, Pan Xu, Keke Huang et al.ICML 2021 · 25 citations
- Optimal and Practical Batched Linear Bandit AlgorithmSanghoon Yu, Min-hwan OhICML 2025
- Almost Optimal Batch-Regret Tradeoff for Batch Linear Contextual BanditsZihan Zhang, Xiangyang Ji, Yuan ZhouICLR 2025
- Optimal Batched Linear BanditsXuanfei Ren, Tianyuan Jin, Pan XuICML 2024 · 6 citations
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 2 citations
