(Locally) Differentially Private Combinatorial Semi-Bandits
Xiaoyu Chen, Kai Zheng, Zixin Zhou, Yunchang Yang, Wei Chen, Liwei Wang
Abstract
In this paper, we study Combinatorial Semi-Bandits (CSB) that is an extension of classic Multi-Armed Bandits (MAB) under Differential Privacy (DP) and stronger Local Differential Privacy (LDP) setting. Since the server receives more information from users in CSB, it usually causes additional dependence on the dimension of data, which is a notorious side-effect for privacy preserving learning. However for CSB under two common smoothness assumptions , we show it is possible to remove this side-effect. In detail, for -bounded smooth CSB under either -LDP or -DP, we prove the optimal regret bound is or respectively, where is time period, is the gap of rewards and is the number of base arms, by proposing novel algorithms and matching lower bounds. For -bounded smooth CSB under -DP, we also prove the optimal regret bound is with both upper bound and lower bound, where is the maximum number of feedback in each round. All above results nearly match corresponding non-private optimal rates, which imply there is no additional price for (locally) differentially private CSB in above common settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fbdae99f-2209-4b8c-bdfe-2c91eeb4bd78Cited by top-tier papers7
- Large Scale Private Learning via Low-rank ReparametrizationDa Yu, Huishuai Zhang, Wei Chen, Jian Yin et al.ICML 2021 · 122 citations
- Local Differential Privacy for Regret Minimization in Reinforcement LearningEvrard Garcelon, Vianney Perchet, Ciara Pike-Burke, Matteo PirottaNeurIPS 2021 · 47 citations
- Offline Reinforcement Learning with Differential PrivacyDan Qiao, Yu-Xiang WangNeurIPS 2023 · 34 citations
- Shuffle Private Linear Contextual BanditsSayak Ray Chowdhury, Xingyu ZhouICML 2022 · 29 citations
- Differentially Private Regret Minimization in Episodic Markov Decision ProcessesSayak Ray Chowdhury, Xingyu ZhouAAAI 2022 · 26 citations
Related papers
- Federated Linear Contextual Bandits with User-level Differential PrivacyRuiquan Huang, Huanyu Zhang, Luca Melis, Milan Shen et al.ICML 2023 · 17 citations
- Locally Differentially Private (Contextual) Bandits LearningKai Zheng, Tianle Cai, Weiran Huang, Zhenguo Li et al.NeurIPS 2020 · 76 citations
- Robust and private stochastic linear banditsVasileios Charisopoulos, Hossein Esfandiari, Vahab MirrokniICML 2023 · 10 citations
- Differentially Private Multi-Armed Bandits in the Shuffle ModelJay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri StemmerNeurIPS 2021 · 37 citations
- Generalized Linear Bandits with Local Differential PrivacyYuxuan Han, Zhipeng Liang, Yang Wang, Jiheng ZhangNeurIPS 2021 · 39 citations
