A Near-optimal, Scalable and Parallelizable Framework for Stochastic Bandits Robust to Adversarial Corruptions and Beyond
Zicheng Hu, Cheng Chen
摘要
We investigate various stochastic bandit problems in the presence of adversarial corruptions. A seminal work for this problem is the BARBAR algorithm, which achieves both robustness and efficiency. However, it suffers from a regret of , which does not match the lower bound of , where denotes the number of arms and denotes the corruption level. In this paper, we first improve the BARBAR algorithm by proposing a novel framework called BARBAT, which eliminates the factor of to achieve an optimal regret bound up to a logarithmic factor. We also extend BARBAT to various settings, including multi-agent bandits, graph bandits, combinatorial semi-bandits and batched bandits. Compared with the Follow-the-Regularized-Leader framework, our methods are more amenable to parallelization, making them suitable for multi-agent and batched bandit settings, and they incur lower computational costs, particularly in semi-bandit problems. Numerical experiments verify the efficiency of the proposed methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Inference for Batched BanditsKelly W. Zhang, Lucas Janson, Susan A. MurphyNeurIPS 2020 · 被引用 115 次
- Regret Bounds for Batched BanditsHossein Esfandiari, Amin Karbasi, Abbas Mehrabian, Vahab S. MirrokniAAAI 2021 · 被引用 74 次
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 被引用 31 次
- Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback GraphsShinji Ito, Taira Tsuchiya, Junya HondaNeurIPS 2022 · 被引用 29 次
- Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal ArmsTiancheng Jin, Junyan Liu, Haipeng LuoNeurIPS 2023 · 被引用 24 次
相关 Paper
- Robust Decentralized Multi-armed Bandits: From Corruption-Resilience to Byzantine-ResilienceZicheng Hu, Yuchen Wang, Cheng ChenAAAI 2026
- On Optimal Robustness to Adversarial Corruption in Online Decision ProblemsShinji ItoNeurIPS 2021 · 被引用 28 次
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 被引用 2 次
- Adversarial Bandits with Corruptions: Regret Lower Bound and No-regret AlgorithmLin Yang, Mohammad Hassan Hajiesmaili, Mohammad Sadegh Talebi, John C. S. Lui 等NeurIPS 2020 · 被引用 39 次
- Saving Stochastic Bandits from Poisoning Attacks via Limited Data VerificationAnshuka Rangi, Long Tran-Thanh, Haifeng Xu, Massimo FranceschettiAAAI 2022 · 被引用 16 次
