Follow-the-Perturbed-Leader Nearly Achieves Best-of-Both-Worlds for the m-Set Semi-Bandit Problems
Jingxin Zhan, Yuchen Xin, Chenjie Sun, Zhihua Zhang
摘要
We consider a common case of the combinatorial semi-bandit problem, the m -set semi-bandit, where the learner exactly selects m arms from the total d arms. In the adversarial setting, the best regret bound, known to be O ( √ nmd ) for time horizon n , is achieved by the well-known Follow-the-Regularized-Leader (FTRL) policy. However, this requires to explicitly compute the arm-selection probabilities via optimizing problems at each time step and sample according to them. This problem can be avoided by the Follow-the-Perturbed-Leader (FTPL) policy, which simply pulls the m arms that rank among the m smallest (estimated) loss with random perturbation. In this paper, we show that FTPL with a Fréchet perturbation also enjoys the near optimal regret bound O ( √ nm ( (cid:112) d log( d ) + m 5 / 6 )) in the adversarial setting and approaches best-of-both-world regret bounds, i.e., achieves a logarithmic regret for the stochastic setting. Moreover, our lower bounds show that the extra factors are unavoidable with our approach; any improvement would require a fundamentally different and more challenging method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- The best of both worlds: stochastic and adversarial episodic MDPs with unknown transitionTiancheng Jin, Longbo Huang, Haipeng LuoNeurIPS 2021 · 被引用 51 次
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 被引用 31 次
- Versatile Dueling Bandits: Best-of-both World Analyses for Learning from Relative PreferencesAadirupa Saha, Pierre GaillardICML 2022 · 被引用 30 次
- Follow-the-Perturbed-Leader for Adversarial Markov Decision Processes with Bandit FeedbackYan Dai, Haipeng Luo, Liyu ChenNeurIPS 2022 · 被引用 22 次
相关 Paper
- Geometric Resampling in Nearly Linear Time for Follow-the-Perturbed-Leader with Best-of-Both-Worlds Guarantee in Bandit ProblemsBotao Chen, Jongyeong Lee, Junya HondaICML 2025
- Follow-the-Perturbed-Leader for Decoupled Bandits: Best-of-Both-Worlds and PracticalityChaiwon Kim, Jongyeong Lee, Min-hwan OhICML 2026
- Revisiting Follow-the-Perturbed-Leader with Unbounded Perturbations in Bandit ProblemsJongyeong Lee, Junya Honda, Shinji Ito, Min-hwan OhNeurIPS 2025 · 被引用 3 次
- Trading Off Resource Budgets For Improved Regret BoundsThomas Orton, Damon FalckNeurIPS 2022
- Adversarial Semi-Bandits with Moving ArmsZhiming Huang, Jianping PanINFOCOM 2025
