Pareto Optimal Risk-Agnostic Distributional Bandits with Heavy-Tail Rewards
Kyungjae Lee, Dohyeong Kim, Taehyun Cho, Chaeyeon Kim, Yunkyung Ko, Seungyub Han, Seokhun Ju, Dohyeok Lee, Sungbin Lim
摘要
This paper addresses the problem of multi-risk measure agnostic multi-armed bandits in heavy-tailed reward settings. We propose a framework that leverages novel deviation inequalities for the 1-Wasserstein distance to construct confidence intervals for Lipschitz risk measures. The distributional LCB (DistLCB) algorithm is introduced, which achieves asymptotic optimality by deriving the first lower bounds for risk measure aware bandits with explicit sub-optimality gap dependencies. The DistLCB is further extended to multi-risk objectives, which enables Pareto-optimal solutions that consider multiple aspects of reward distributions. Additionally, we provide a regret analysis that includes both gap-dependent and gap-independent bounds for multi-risk settings. Experiments validate the effectiveness of the proposed methods in synthetic and real-world applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Concentration bounds for CVaR estimation: The cases of light-tailed and heavy-tailed distributionsPrashanth L. A., Krishna P. Jagannathan, Ravi Kumar KollaICML 2020 · 被引用 53 次
- Optimal Thompson Sampling strategies for support-aware CVaR banditsDorian Baudry, Romain Gautron, Emilie Kaufmann, Odalric MaillardICML 2021 · 被引用 40 次
- Optimal Algorithms for Stochastic Multi-Armed Bandits with Heavy Tailed RewardsKyungjae Lee, Hongjun Yang, Sungbin Lim, Songhwai OhNeurIPS 2020 · 被引用 34 次
- Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed BanditsJiatai Huang, Yan Dai, Longbo HuangICML 2022 · 被引用 24 次
- Quantile Bandits for Best Arms IdentificationMengyan Zhang, Cheng Soon OngICML 2021 · 被引用 13 次
相关 Paper
- Optimal Best-Arm Identification Methods for Tail-Risk MeasuresShubhada Agrawal, Wouter M. Koolen, Sandeep JunejaNeurIPS 2021 · 被引用 34 次
- Bayesian Regret Minimization in Offline BanditsMarek Petrik, Guy Tennenholtz, Mohammad GhavamzadehICML 2024
- Taming Heavy-Tailed Losses in Adversarial Bandits and the Best-of-Both-Worlds SettingDuo Cheng, Xingyu Zhou, Bo JiNeurIPS 2024 · 被引用 3 次
- A Simple and Optimal Policy Design for Online Learning with Safety against Heavy-tailed RiskDavid Simchi-Levi, Zeyu Zheng, Feng ZhuNeurIPS 2022 · 被引用 7 次
- Continuous Mean-Covariance BanditsYihan Du, Siwei Wang, Zhixuan Fang, Longbo HuangNeurIPS 2021 · 被引用 5 次
