Finite and Corruption-Robust Regret Bounds in Online Inverse Linear Optimization under M-Convex Action Sets
Taihei Oki, Shinsaku Sakaue
摘要
We study online inverse linear optimization, also known as contextual recommendation, where a learner sequentially infers an agent’s hidden objective vector from observed optimal actions over feasible sets that change over time. The learner aims to recommend actions that perform well under the agent’s true objective, and the performance is measured by the regret, defined as the cumulative gap between the agent’s optimal values and those achieved by the learner's recommended actions. Prior work has established a regret bound of , as well as a finite but exponentially large bound of , where is the dimension of the optimization problem and is the time horizon, while a regret lower bound of is known (Gollapudi et al. 2021; Sakaue et al. 2025). Whether a finite regret bound polynomial in is achievable or not has remained an open question. We partially resolve this by showing that when the feasible sets are M-convex—a broad class that includes matroids—a finite regret bound of is possible. We achieve this by combining a structural characterization of optimal solutions on M-convex sets with a geometric volume argument. Moreover, we extend our approach to adversarially corrupted feedback in up to rounds. We obtain a regret bound of without prior knowledge of , by monitoring directed graphs induced by the observed feedback to detect corruptions adaptively.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Contextual Recommendations and Low-Regret Cutting-Plane AlgorithmsSreenivas Gollapudi, Guru Guruganesh, Kostas Kollias, Pasin Manurangsi 等NeurIPS 2021 · 被引用 17 次
- Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear ProgrammingChunlin Sun, Shang Liu, Xiaocheng LiICML 2023 · 被引用 13 次
- Optimal Contextual Pricing and ExtensionsAllen Liu, Renato Paes Leme, Jon SchneiderSODA 2021 · 被引用 13 次
- Online Inverse Linear Optimization: Efficient Logarithmic-Regret Algorithm, Robustness to Suboptimality, and Lower BoundShinsaku Sakaue, Taira Tsuchiya, Han Bao, Taihei OkiNeurIPS 2025 · 被引用 9 次
相关 Paper
- Fast Rates in Stochastic Online Convex Optimization by Exploiting the Curvature of Feasible SetsTaira Tsuchiya, Shinji ItoNeurIPS 2024 · 被引用 2 次
- No-Regret M♮-Concave Function Maximization: Stochastic Bandit Algorithms and NP-Hardness of Adversarial Full-Information SettingTaihei Oki, Shinsaku SakaueNeurIPS 2024 · 被引用 2 次
- Dynamic Regret Reduces to Kernelized Static RegretAndrew Jacobsen, Alessandro Rudi, Francesco Orabona, Nicolò Cesa-BianchiNeurIPS 2025 · 被引用 6 次
- Learning from Stochastically Revealed PreferenceJohn R. Birge, Xiaocheng Li, Chunlin SunNeurIPS 2022 · 被引用 8 次
- Optimal regret algorithm for Pseudo-1d Bandit Convex OptimizationAadirupa Saha, Nagarajan Natarajan, Praneeth Netrapalli, Prateek JainICML 2021 · 被引用 5 次
