Robustness Guarantees for Mode Estimation with an Application to Bandits
Aldo Pacchiano, Heinrich Jiang, Michael I. Jordan
Abstract
Mode estimation is a classical problem in statistics with a wide range of applications in machine learning. Despite this, there is little understanding in its robustness properties under possibly adversarial data contamination. In this paper, we give precise robustness guarantees as well as privacy guarantees under simple randomization. We then introduce a theory for multi-armed bandits where the values are the modes of the reward distributions instead of the mean. We prove regret guarantees for the problems of top arm identification, top m-arms identification, contextual modal bandits, and infinite continuous arms top arm recovery. We show in simulations that our algorithms are robust to perturbation of the arms by adversarial noise sequences, thus rendering modal bandits an attractive choice in situations where the rewards may have outliers or adversarial corruptions. * Equal contribution.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4ddc92f3-4a01-47d0-9beb-457912eca60cRelated papers
- Best Arm Identification in Contaminated Stochastic BanditsArpan Mukherjee, Ali Tajer, Pin-Yu Chen, Payel DasNeurIPS 2021 · 1 citation
- On Private and Robust BanditsYulian Wu, Xingyu Zhou, Youming Tao, Di WangNeurIPS 2023 · 12 citations
- Minimax M-estimation under Adversarial ContaminationSujay Bhatt, Guanhua Fang, Ping Li, Gennady SamorodnitskyICML 2022 · 9 citations
- Locally Private and Robust Multi-Armed BanditsXingyu Zhou, Komo (Wei) ZhangNeurIPS 2024 · 5 citations
- Robust Bandit Learning with Imperfect ContextJianyi Yang, Shaolei RenAAAI 2021 · 9 citations
