Instance-Dependent Regret Bounds for Nonstochastic Linear Partial Monitoring
Federico Di Gennaro, Khaled Eldowa, Nicolò Cesa-Bianchi
Abstract
In contrast to the classic formulation of partial monitoring, linear partial monitoring can model infinite outcome spaces, while imposing a linear structure on both the losses and the observations. This setting can be viewed as a generalization of linear bandits where loss and feedback are decoupled in a flexible manner. In this work, we address a nonstochastic (adversarial), finite-actions version of the problem through a simple instance of the exploration-by-optimization method that is amenable to efficient implementation. We derive regret bounds that depend on the game structure in a more transparent manner than previous theoretical guarantees for this paradigm. Our bounds feature instance-specific quantities that reflect the degree of alignment between observations and losses, and resemble known guarantees in the stochastic setting. Notably, they achieve the standard rate in easy (locally observable) games and in hard (globally observable) games, where is the time horizon. We instantiate these bounds in a selection of old and new partial information settings subsumed by this model, and illustrate that the achieved dependence on the game structure can be tight in interesting cases.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7543a4ca-a8d5-4082-a627-b07be375e928Builds on6
- On the Complexity of Adversarial Decision MakingDylan J. Foster, Alexander Rakhlin, Ayush Sekhari, Karthik SridharanNeurIPS 2022 · 37 citations
- Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worldsTaira Tsuchiya, Shinji Ito, Junya HondaNeurIPS 2023 · 17 citations
- Analysis and Design of Thompson Sampling for Stochastic Partial MonitoringTaira Tsuchiya, Junya Honda, Masashi SugiyamaNeurIPS 2020 · 9 citations
- An Exploration-by-Optimization Approach to Best of Both Worlds in Linear BanditsShinji Ito, Kei TakemuraNeurIPS 2023 · 7 citations
- Exploration by Optimization with Hybrid Regularizers: Logarithmic Regret with Adversarial Robustness in Partial MonitoringTaira Tsuchiya, Shinji Ito, Junya HondaICML 2024 · 3 citations
Related papers
- On Adaptivity in Information-Constrained Online LearningSiddharth Mitra, Aditya GopalanAAAI 2020 · 4 citations
- Bandit Linear ControlAsaf B. Cassel, Tomer KorenNeurIPS 2020 · 19 citations
- Delayed Bandits: When Do Intermediate Observations Help?Emmanuel Esposito, Saeed Masoudian, Hao Qiu, Dirk van der Hoeven et al.ICML 2023 · 5 citations
- Stochastic Linear Bandits with Parameter NoiseDaniel Ezer, Alon Peled-Cohen, Yishay MansourICML 2026
- Optimistic Policy Optimization with Bandit FeedbackLior Shani, Yonathan Efroni, Aviv Rosenberg, Shie MannorICML 2020 · 100 citations
