A Near-Optimal Best-of-Both-Worlds Algorithm for Federated Bandits
Zicheng Hu, Zihao Wang, Cheng Chen
摘要
This paper studies federated multi-armed bandit (MAB) problems in which multiple agents work together to solve a common MAB problem through a communication network. We focus on the heterogeneous setting in which no single agent can identify the globally best arm using only locally biased observations. In this setting, different agents may select the same arm at the same time step, but receive different rewards. We propose a novel algorithm called FedFTRL for this problem and, to our knowledge, it is the first to achieve near-optimal regret guarantees in both stochastic and adversarial environments. Notably, in the adversarial regime, our algorithm achieves regret, a significant improvement over the state-of-the-art regret of . We also provide empirical evaluations comparing our algorithm with baseline methods, demonstrating the effectiveness of our approach on both synthetic and real-world datasets.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper9
- Differentially-Private Federated Linear BanditsAbhimanyu Dubey, Alex 'Sandy' PentlandNeurIPS 2020 · 被引用 138 次
- Federated Linear Contextual BanditsRuiquan Huang, Weiqiang Wu, Jing Yang, Cong ShenNeurIPS 2021 · 被引用 94 次
- Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits SimultaneouslyChung-Wei Lee, Haipeng Luo, Chen-Yu Wei, Mengxiao Zhang 等ICML 2021 · 被引用 53 次
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 被引用 31 次
- A Best-of-Both-Worlds Algorithm for Bandits with Delayed FeedbackSaeed Masoudian, Julian Zimmert, Yevgeny SeldinNeurIPS 2022 · 被引用 30 次
相关 Paper
- Doubly Adversarial Federated BanditsJialin Yi, Milan VojnovicICML 2023 · 被引用 6 次
- Distributed Bandits with Heterogeneous AgentsLin Yang, Yu-Zhen Janice Chen, Mohammad Hassan Hajiesmaili, John C. S. Lui 等INFOCOM 2022 · 被引用 12 次
- Federated Multi-Armed BanditsChengshuai Shi, Cong ShenAAAI 2021 · 被引用 114 次
- A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear BanditsJiafan He, Tianhao Wang, Yifei Min, Quanquan GuNeurIPS 2022 · 被引用 44 次
- Near-Optimal Collaborative Learning in BanditsClémence Réda, Sattar Vakili, Emilie KaufmannNeurIPS 2022 · 被引用 23 次
