Efficient Best-of-Both-Worlds Algorithms for Contextual Combinatorial Semi-Bandits
Mengmeng Li, Philipp Schneider, Jelisaveta Aleksic, Daniel Kuhn
Abstract
We introduce the first best-of-both-worlds algorithm for contextual combinatorial semi-bandits that simultaneously guarantees regret in the adversarial regime and regret in the corrupted stochastic regime. Our approach builds on the Follow-the-Regularized-Leader (FTRL) framework equipped with a Shannon entropy regularizer, yielding a flexible method that admits efficient implementations. Beyond regret bounds, we tackle the practical bottleneck in FTRL (or, equivalently, Online Stochastic Mirror Descent) arising from the high-dimensional projection step encountered in each round of interaction. By leveraging the Karush-Kuhn-Tucker conditions, we transform the -dimensional convex projection problem into a single-variable root-finding problem, dramatically accelerating each round. Empirical evaluations demonstrate that this combined strategy not only attains the attractive regret bounds of best-of-both-worlds algorithms but also delivers substantial per-round speed-ups, making it well-suited for large-scale, real-time applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e8e1a147-0786-43e3-9f51-e2bcf1ea066cBuilds on7
- Adapting to Misspecification in Contextual BanditsDylan J. Foster, Claudio Gentile, Mehryar Mohri, Julian ZimmertNeurIPS 2020 · 111 citations
- Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits SimultaneouslyChung-Wei Lee, Haipeng Luo, Chen-Yu Wei, Mengxiao Zhang et al.ICML 2021 · 53 citations
- Hybrid Regret Bounds for Combinatorial Semi-Bandits and Adversarial Linear BanditsShinji ItoNeurIPS 2021 · 31 citations
- Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback GraphsShinji Ito, Taira Tsuchiya, Junya HondaNeurIPS 2022 · 29 citations
- Bypassing the Simulator: Near-Optimal Adversarial Linear Contextual BanditsHaolin Liu, Chen-Yu Wei, Julian ZimmertNeurIPS 2023 · 20 citations
Related papers
- Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal ArmsTiancheng Jin, Junyan Liu, Haipeng LuoNeurIPS 2023 · 24 citations
- A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of and its Application to Best-of-Both-WorldsTaira Tsuchiya, Shinji ItoNeurIPS 2024
- Follow-the-Perturbed-Leader Nearly Achieves Best-of-Both-Worlds for the m-Set Semi-Bandit ProblemsJingxin Zhan, Yuchen Xin, Chenjie Sun, Zhihua ZhangNeurIPS 2025 · 1 citation
- Adversarial Combinatorial Bandits with Switching Cost and Arm Selection ConstraintsYin Huang, Qingsong Liu, Jie XuINFOCOM 2024 · 10 citations
- Best-of-three-worlds Analysis for Dueling Bandits with Borda WinnerZirui Hu, Tingyu Zhang, Fang KongICLR 2026
