Dealing With Misspecification In Fixed-Confidence Linear Top-m Identification
Clémence Réda, Andrea Tirinzoni, Rémy Degenne
Abstract
We study the problem of the identification of m arms with largest means under a fixed error rate (fixed-confidence Top-m identification), for misspecified linear bandit models. This problem is motivated by practical applications, especially in medicine and recommendation systems, where linear models are popular due to their simplicity and the existence of efficient algorithms, but in which data inevitably deviates from linearity. In this work, we first derive a tractable lower bound on the sample complexity of any -correct algorithm for the general Top-m identification problem. We show that knowing the scale of the deviation from linearity is necessary to exploit the structure of the problem. We then describe the first algorithm for this setting, which is both practical and adapts to the amount of misspecification. We derive an upper bound to its sample complexity which confirms this adaptivity and that matches the lower bound when 0. Finally, we evaluate our algorithm on both synthetic and real-world data, showing competitive performance with respect to existing baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Near-Optimal Collaborative Learning in BanditsClémence Réda, Sattar Vakili, Emilie KaufmannNeurIPS 2022 · 23 citations
- On Elimination Strategies for Bandit Fixed-Confidence IdentificationAndrea Tirinzoni, Rémy DegenneNeurIPS 2022 · 12 citations
- Choosing Answers in Epsilon-Best-Answer Identification for Linear BanditsMarc Jourdan, Rémy DegenneICML 2022 · 4 citations
- Constrained Pareto Set Identification with Bandit FeedbackCyrille Kone, Emilie Kaufmann, Laura RichertICML 2025
Builds on10
- Learning Near Optimal Policies with Low Inherent Bellman ErrorAndrea Zanette, Alessandro Lazaric, Mykel J. Kochenderfer, Emma BrunskillICML 2020 · 238 citations
- Learning with Good Feature Representations in Bandits and in RL with a Generative ModelTor Lattimore, Csaba Szepesvári, Gellért WeiszICML 2020 · 181 citations
- Adapting to Misspecification in Contextual BanditsDylan J. Foster, Claudio Gentile, Mehryar Mohri, Julian ZimmertNeurIPS 2020 · 111 citations
- Model Selection in Contextual Stochastic Bandit ProblemsAldo Pacchiano, My Phan, Yasin Abbasi-Yadkori, Anup Rao et al.NeurIPS 2020 · 107 citations
- Optimal Best-arm Identification in Linear BanditsYassir Jedra, Alexandre ProutièreNeurIPS 2020 · 99 citations
Related papers
- Covariance-adaptive best arm identificationEl Mehdi Saad, Gilles Blanchard, Nicolas VerzelenNeurIPS 2023 · 1 citation
- Learning the Best Under Constraints: A Duality-Based FrameworkMingjie Hu, Enlu Zhou, Jianqiang HuICML 2026
- Robust Pure Exploration in Linear Bandits with Limited BudgetAyya Alieva, Ashok Cutkosky, Abhimanyu DasICML 2021 · 27 citations
- Fixed Confidence Best Arm Identification in the Bayesian SettingKyoungseok Jang, Junpei Komiyama, Kazutoshi YamazakiNeurIPS 2024
- Best Arm Identification in Contaminated Stochastic BanditsArpan Mukherjee, Ali Tajer, Pin-Yu Chen, Payel DasNeurIPS 2021 · 1 citation
