On Private and Robust Bandits
Yulian Wu, Xingyu Zhou, Youming Tao, Di Wang
Abstract
We study private and robust multi-armed bandits (MABs), where the agent receives Huber's contaminated heavy-tailed rewards and meanwhile needs to ensure differential privacy. We first present its minimax lower bound, characterizing the information-theoretic limit of regret with respect to privacy budget, contamination level and heavy-tailedness. Then, we propose a meta-algorithm that builds on a private and robust mean estimation sub-routine PRM that essentially relies on reward truncation and the Laplace mechanism only. For two different heavy-tailed settings, we give specific schemes of PRM, which enable us to achieve nearly-optimal regret. As by-products of our main results, we also give the first minimax lower bound for private heavy-tailed MABs (i.e., without contamination). Moreover, our two proposed truncation-based PRM achieve the optimal trade-off between estimation accuracy, privacy and robustness. Finally, we support our theoretical results with experimental studies.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e0395ba5-1199-44a5-b856-613b4b59f876Cited by top-tier papers8
- Private Heterogeneous Federated Learning Without a Trusted Server Revisited: Error-Optimal and Communication-Efficient Algorithms for Convex LossesChangyu Gao, Andrew Lowy, Xingyu Zhou, Stephen J. WrightICML 2024 · 10 citations
- Robust Neural Contextual Bandit against Adversarial CorruptionsYunzhe Qi, Yikun Ban, Arindam Banerjee, Jingrui HeNeurIPS 2024 · 7 citations
- Locally Private and Robust Multi-Armed BanditsXingyu Zhou, Komo (Wei) ZhangNeurIPS 2024 · 5 citations
- Improved Bounds for Private and Robust AlignmentWenqian Weng, Yi He, Xingyu ZhouICML 2026 · 3 citations
- On the Sample Complexity of Differentially Private Policy OptimizationYi He, Xingyu ZhouNeurIPS 2025 · 3 citations
Builds on7
- Privacy Induces Robustness: Information-Computation Gaps and Sparse Mean EstimationKristian Georgiev, Samuel B. HopkinsNeurIPS 2022 · 38 citations
- Differentially Private Multi-Armed Bandits in the Shuffle ModelJay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri StemmerNeurIPS 2021 · 37 citations
- When Privacy Meets Partial Information: A Refined Analysis of Differentially Private BanditsAchraf Azize, Debabrota BasuNeurIPS 2022 · 34 citations
- Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanismSamuel B. Hopkins, Gautam Kamath, Mahbod MajidSTOC 2022 · 20 citations
- Robustness Implies Privacy in Statistical EstimationSamuel B. Hopkins, Gautam Kamath, Mahbod Majid, Shyam NarayananSTOC 2023 · 16 citations
Related papers
- Differentially Private Episodic Reinforcement Learning with Heavy-tailed RewardsYulian Wu, Xingyu Zhou, Sayak Ray Chowdhury, Di WangICML 2023 · 4 citations
- Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed PayoffsHan Zhong, Jiayi Huang, Lin Yang, Liwei WangNeurIPS 2021 · 12 citations
- Taming Heavy-Tailed Losses in Adversarial Bandits and the Best-of-Both-Worlds SettingDuo Cheng, Xingyu Zhou, Bo JiNeurIPS 2024 · 3 citations
- Optimal Algorithms for Stochastic Multi-Armed Bandits with Heavy Tailed RewardsKyungjae Lee, Hongjun Yang, Sungbin Lim, Songhwai OhNeurIPS 2020 · 34 citations
- Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed BanditsJiatai Huang, Yan Dai, Longbo HuangICML 2022 · 24 citations
