On Private and Robust Bandits
Yulian Wu, Xingyu Zhou, Youming Tao, Di Wang
摘要
We study private and robust multi-armed bandits (MABs), where the agent receives Huber's contaminated heavy-tailed rewards and meanwhile needs to ensure differential privacy. We first present its minimax lower bound, characterizing the information-theoretic limit of regret with respect to privacy budget, contamination level and heavy-tailedness. Then, we propose a meta-algorithm that builds on a private and robust mean estimation sub-routine PRM that essentially relies on reward truncation and the Laplace mechanism only. For two different heavy-tailed settings, we give specific schemes of PRM, which enable us to achieve nearly-optimal regret. As by-products of our main results, we also give the first minimax lower bound for private heavy-tailed MABs (i.e., without contamination). Moreover, our two proposed truncation-based PRM achieve the optimal trade-off between estimation accuracy, privacy and robustness. Finally, we support our theoretical results with experimental studies.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- Private Heterogeneous Federated Learning Without a Trusted Server Revisited: Error-Optimal and Communication-Efficient Algorithms for Convex LossesChangyu Gao, Andrew Lowy, Xingyu Zhou, Stephen J. WrightICML 2024 · 被引用 10 次
- Robust Neural Contextual Bandit against Adversarial CorruptionsYunzhe Qi, Yikun Ban, Arindam Banerjee, Jingrui HeNeurIPS 2024 · 被引用 7 次
- Locally Private and Robust Multi-Armed BanditsXingyu Zhou, Komo (Wei) ZhangNeurIPS 2024 · 被引用 5 次
- Improved Bounds for Private and Robust AlignmentWenqian Weng, Yi He, Xingyu ZhouICML 2026 · 被引用 3 次
- On the Sample Complexity of Differentially Private Policy OptimizationYi He, Xingyu ZhouNeurIPS 2025 · 被引用 3 次
它引用的顶会 Paper7
- Privacy Induces Robustness: Information-Computation Gaps and Sparse Mean EstimationKristian Georgiev, Samuel B. HopkinsNeurIPS 2022 · 被引用 38 次
- Differentially Private Multi-Armed Bandits in the Shuffle ModelJay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri StemmerNeurIPS 2021 · 被引用 37 次
- When Privacy Meets Partial Information: A Refined Analysis of Differentially Private BanditsAchraf Azize, Debabrota BasuNeurIPS 2022 · 被引用 34 次
- Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanismSamuel B. Hopkins, Gautam Kamath, Mahbod MajidSTOC 2022 · 被引用 20 次
- Robustness Implies Privacy in Statistical EstimationSamuel B. Hopkins, Gautam Kamath, Mahbod Majid, Shyam NarayananSTOC 2023 · 被引用 16 次
相关 Paper
- Differentially Private Episodic Reinforcement Learning with Heavy-tailed RewardsYulian Wu, Xingyu Zhou, Sayak Ray Chowdhury, Di WangICML 2023 · 被引用 4 次
- Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed PayoffsHan Zhong, Jiayi Huang, Lin Yang, Liwei WangNeurIPS 2021 · 被引用 12 次
- Taming Heavy-Tailed Losses in Adversarial Bandits and the Best-of-Both-Worlds SettingDuo Cheng, Xingyu Zhou, Bo JiNeurIPS 2024 · 被引用 3 次
- Optimal Algorithms for Stochastic Multi-Armed Bandits with Heavy Tailed RewardsKyungjae Lee, Hongjun Yang, Sungbin Lim, Songhwai OhNeurIPS 2020 · 被引用 34 次
- Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed BanditsJiatai Huang, Yan Dai, Longbo HuangICML 2022 · 被引用 24 次
