Efficient Best-of-Both-Worlds Algorithms for Contextual Combinatorial Semi-Bandits
Mengmeng Li, Philipp Schneider, Jelisaveta Aleksic, Daniel Kuhn
摘要
We introduce the first best-of-both-worlds algorithm for contextual combinatorial semi-bandits that simultaneously guarantees regret in the adversarial regime and regret in the corrupted stochastic regime. Our approach builds on the Follow-the-Regularized-Leader (FTRL) framework equipped with a Shannon entropy regularizer, yielding a flexible method that admits efficient implementations. Beyond regret bounds, we tackle the practical bottleneck in FTRL (or, equivalently, Online Stochastic Mirror Descent) arising from the high-dimensional projection step encountered in each round of interaction. By leveraging the Karush-Kuhn-Tucker conditions, we transform the -dimensional convex projection problem into a single-variable root-finding problem, dramatically accelerating each round. Empirical evaluations demonstrate that this combined strategy not only attains the attractive regret bounds of best-of-both-worlds algorithms but also delivers substantial per-round speed-ups, making it well-suited for large-scale, real-time applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Adapting to Misspecification in Contextual BanditsDylan J. Foster, Claudio Gentile, Mehryar Mohri, Julian ZimmertNeurIPS 2020 · 被引用 111 次
- Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits SimultaneouslyChung-Wei Lee, Haipeng Luo, Chen-Yu Wei, Mengxiao Zhang 等ICML 2021 · 被引用 53 次
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 被引用 31 次
- Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback GraphsShinji Ito, Taira Tsuchiya, Junya HondaNeurIPS 2022 · 被引用 29 次
- Bypassing the Simulator: Near-Optimal Adversarial Linear Contextual BanditsHaolin Liu, Chen-Yu Wei, Julian ZimmertNeurIPS 2023 · 被引用 20 次
相关 Paper
- Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal ArmsTiancheng Jin, Junyan Liu, Haipeng LuoNeurIPS 2023 · 被引用 24 次
- A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of and its Application to Best-of-Both-WorldsTaira Tsuchiya, Shinji ItoNeurIPS 2024
- Follow-the-Perturbed-Leader Nearly Achieves Best-of-Both-Worlds for the m-Set Semi-Bandit ProblemsJingxin Zhan, Yuchen Xin, Chenjie Sun, Zhihua ZhangNeurIPS 2025 · 被引用 1 次
- Adversarial Combinatorial Bandits with Switching Cost and Arm Selection ConstraintsYin Huang, Qingsong Liu, Jie XuINFOCOM 2024 · 被引用 10 次
- Best-of-three-worlds Analysis for Dueling Bandits with Borda WinnerZirui Hu, Tingyu Zhang, Fang KongICLR 2026
