Batch-Size Independent Regret Bounds for Combinatorial Semi-Bandits with Probabilistically Triggered Arms or Independent Arms
Xutong Liu, Jinhang Zuo, Siwei Wang, Carlee Joe-Wong, John C. S. Lui, Wei Chen
摘要
In this paper, we study the combinatorial semi-bandits (CMAB) and focus on reducing the dependency of the batch-size in the regret bound, where is the total number of arms that can be pulled or triggered in each round. First, for the setting of CMAB with probabilistically triggered arms (CMAB-T), we discover a novel (directional) triggering probability and variance modulated (TPVM) condition that can replace the previously-used smoothness condition for various applications, such as cascading bandits, online network exploration and online influence maximization. Under this new condition, we propose a BCUCB-T algorithm with variance-aware confidence intervals and conduct regret analysis which reduces the factor to or in the regret bound, significantly improving the regret bounds for the above applications. Second, for the setting of non-triggering CMAB with independent arms, we propose a SESCB algorithm which leverages on the non-triggering version of the TPVM condition and completely removes the dependency on in the leading regret. As a valuable by-product, the regret analysis used in this paper can improve several existing results by a factor of . Finally, experimental evaluations show our superior performance compared with benchmark algorithms in different applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- Contextual Combinatorial Bandits with Probabilistically Triggered ArmsXutong Liu, Jinhang Zuo, Siwei Wang, John C. S. Lui 等ICML 2023 · 被引用 26 次
- Minimax Regret for Cascading BanditsDaniel Vial, Sujay Sanghavi, Sanjay Shakkottai, R. SrikantNeurIPS 2022 · 被引用 18 次
- Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous UsersHantao Yang, Xutong Liu, Zhiyong Wang, Hong Xie 等AAAI 2024 · 被引用 10 次
- Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and BeyondXutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong 等ICML 2024 · 被引用 9 次
- Online Corrupted User Detection and Regret MinimizationZhiyong Wang, Jize Xie, Tong Yu, Shuai Li 等NeurIPS 2023 · 被引用 8 次
它引用的顶会 Paper5
- Improved Variance-Aware Confidence Sets for Linear Bandits and Linear Mixture MDPZihan Zhang, Jiaqi Yang, Xiangyang Ji, Simon S. DuNeurIPS 2021 · 被引用 50 次
- Online Influence Maximization under Linear Threshold ModelShuai Li, Fang Kong, Kejie Tang, Qizhi Li 等NeurIPS 2020 · 被引用 45 次
- Budgeted Online Influence MaximizationPierre Perrault, Jennifer Healey, Zheng Wen, Michal ValkoICML 2020 · 被引用 20 次
- Minimax Regret for Cascading BanditsDaniel Vial, Sujay Sanghavi, Sanjay Shakkottai, R. SrikantNeurIPS 2022 · 被引用 18 次
- Multi-layered Network Exploration via Random Walks: From Offline Optimization to Online LearningXutong Liu, Jinhang Zuo, Xiaowei Chen, Wei Chen 等ICML 2021 · 被引用 17 次
相关 Paper
- When Combinatorial Thompson Sampling meets Approximation RegretPierre PerraultNeurIPS 2022 · 被引用 9 次
- Combinatorial Stochastic-Greedy BanditFares Fourati, Christopher John Quinn, Mohamed-Slim Alouini, Vaneet AggarwalAAAI 2024 · 被引用 14 次
- Cascading Contextual Assortment BanditsHyun-Jun Choi, Rajan Udwani, Min-hwan OhNeurIPS 2023 · 被引用 4 次
- Statistical Efficiency of Thompson Sampling for Combinatorial Semi-BanditsPierre Perrault, Etienne Boursier, Michal Valko, Vianney PerchetNeurIPS 2020 · 被引用 45 次
- Near-Optimal Regret Bounds for Contextual Combinatorial Semi-Bandits with Linear Payoff FunctionsKei Takemura, Shinji Ito, Daisuke Hatano, Hanna Sumita 等AAAI 2021 · 被引用 7 次
