Instance-Dependent Regret Bounds for Nonstochastic Linear Partial Monitoring
Federico Di Gennaro, Khaled Eldowa, Nicolò Cesa-Bianchi
摘要
In contrast to the classic formulation of partial monitoring, linear partial monitoring can model infinite outcome spaces, while imposing a linear structure on both the losses and the observations. This setting can be viewed as a generalization of linear bandits where loss and feedback are decoupled in a flexible manner. In this work, we address a nonstochastic (adversarial), finite-actions version of the problem through a simple instance of the exploration-by-optimization method that is amenable to efficient implementation. We derive regret bounds that depend on the game structure in a more transparent manner than previous theoretical guarantees for this paradigm. Our bounds feature instance-specific quantities that reflect the degree of alignment between observations and losses, and resemble known guarantees in the stochastic setting. Notably, they achieve the standard rate in easy (locally observable) games and in hard (globally observable) games, where is the time horizon. We instantiate these bounds in a selection of old and new partial information settings subsumed by this model, and illustrate that the achieved dependence on the game structure can be tight in interesting cases.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- On the Complexity of Adversarial Decision MakingDylan J. Foster, Alexander Rakhlin, Ayush Sekhari, Karthik SridharanNeurIPS 2022 · 被引用 37 次
- Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worldsTaira Tsuchiya, Shinji Ito, Junya HondaNeurIPS 2023 · 被引用 17 次
- Analysis and Design of Thompson Sampling for Stochastic Partial MonitoringTaira Tsuchiya, Junya Honda, Masashi SugiyamaNeurIPS 2020 · 被引用 9 次
- An Exploration-by-Optimization Approach to Best of Both Worlds in Linear BanditsShinji Ito, Kei TakemuraNeurIPS 2023 · 被引用 7 次
- Exploration by Optimization with Hybrid Regularizers: Logarithmic Regret with Adversarial Robustness in Partial MonitoringTaira Tsuchiya, Shinji Ito, Junya HondaICML 2024 · 被引用 3 次
相关 Paper
- On Adaptivity in Information-Constrained Online LearningSiddharth Mitra, Aditya GopalanAAAI 2020 · 被引用 4 次
- Bandit Linear ControlAsaf B. Cassel, Tomer KorenNeurIPS 2020 · 被引用 19 次
- Delayed Bandits: When Do Intermediate Observations Help?Emmanuel Esposito, Saeed Masoudian, Hao Qiu, Dirk van der Hoeven 等ICML 2023 · 被引用 5 次
- Stochastic Linear Bandits with Parameter NoiseDaniel Ezer, Alon Peled-Cohen, Yishay MansourICML 2026
- Optimistic Policy Optimization with Bandit FeedbackLior Shani, Yonathan Efroni, Aviv Rosenberg, Shie MannorICML 2020 · 被引用 100 次
