A Near-Optimal Best-of-Both-Worlds Algorithm for Federated Bandits
Zicheng Hu, Zihao Wang, Cheng Chen
Abstract
This paper studies federated multi-armed bandit (MAB) problems in which multiple agents work together to solve a common MAB problem through a communication network. We focus on the heterogeneous setting in which no single agent can identify the globally best arm using only locally biased observations. In this setting, different agents may select the same arm at the same time step, but receive different rewards. We propose a novel algorithm called FedFTRL for this problem and, to our knowledge, it is the first to achieve near-optimal regret guarantees in both stochastic and adversarial environments. Notably, in the adversarial regime, our algorithm achieves regret, a significant improvement over the state-of-the-art regret of . We also provide empirical evaluations comparing our algorithm with baseline methods, demonstrating the effectiveness of our approach on both synthetic and real-world datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7e4d7dd0-bc23-4668-b03b-ad1bc213cfd1Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Differentially-Private Federated Linear BanditsAbhimanyu Dubey, Alex 'Sandy' PentlandNeurIPS 2020 · 138 citations
- Federated Linear Contextual BanditsRuiquan Huang, Weiqiang Wu, Jing Yang, Cong ShenNeurIPS 2021 · 94 citations
- Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits SimultaneouslyChung-Wei Lee, Haipeng Luo, Chen-Yu Wei, Mengxiao Zhang et al.ICML 2021 · 53 citations
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 31 citations
- A Best-of-Both-Worlds Algorithm for Bandits with Delayed FeedbackSaeed Masoudian, Julian Zimmert, Yevgeny SeldinNeurIPS 2022 · 30 citations
Related papers
- Doubly Adversarial Federated BanditsJialin Yi, Milan VojnovicICML 2023 · 6 citations
- Distributed Bandits with Heterogeneous AgentsLin Yang, Yu-Zhen Janice Chen, Mohammad Hassan Hajiesmaili, John C. S. Lui et al.INFOCOM 2022 · 12 citations
- Federated Multi-Armed BanditsChengshuai Shi, Cong ShenAAAI 2021 · 114 citations
- A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear BanditsJiafan He, Tianhao Wang, Yifei Min, Quanquan GuNeurIPS 2022 · 44 citations
- Near-Optimal Collaborative Learning in BanditsClémence Réda, Sattar Vakili, Emilie KaufmannNeurIPS 2022 · 23 citations
