No-Regret M♮-Concave Function Maximization: Stochastic Bandit Algorithms and NP-Hardness of Adversarial Full-Information Setting
Taihei Oki, Shinsaku Sakaue
摘要
M-concave functions, a.k.a. gross substitute valuation functions, play a fundamental role in many fields, including discrete mathematics and economics. In practice, perfect knowledge of M-concave functions is often unavailable a priori, and we can optimize them only interactively based on some feedback. Motivated by such situations, we study online M-concave function maximization problems, which are interactive versions of the problem studied by Murota and Shioura (1999). For the stochastic bandit setting, we present -simple regret and -regret algorithms under times access to unbiased noisy value oracles of M-concave functions. A key to proving these results is the robustness of the greedy algorithm to local errors in M-concave function maximization, which is one of our main technical results. While we obtain those positive results for the stochastic setting, another main result of our work is an impossibility in the adversarial setting. We prove that, even with full-information feedback, no algorithms that run in polynomial time per round can achieve regret for any constant . Our proof is based on a reduction from the matroid intersection problem for three matroids, which would be a novel approach to establishing the hardness in online learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper9
- Adversarial Combinatorial Bandits with General Non-linear Reward FunctionsYanjun Han, Yining Wang, Xi ChenICML 2021 · 被引用 19 次
- Improved Algorithms for Online Submodular Maximization via First-order Regret BoundsNicholas J. A. Harvey, Christopher Liaw, Tasuku SomaNeurIPS 2020 · 被引用 17 次
- A Framework for Adapting Offline Algorithms to Solve Combinatorial Multi-Armed Bandit Problems with Bandit FeedbackGuanyu Nie, Yididiya Y. Nadew, Yanhui Zhu, Vaneet Aggarwal 等ICML 2023 · 被引用 17 次
- Combinatorial Stochastic-Greedy BanditFares Fourati, Christopher John Quinn, Mohamed-Slim Alouini, Vaneet AggarwalAAAI 2024 · 被引用 14 次
- Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular BanditsZongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun 等ICML 2023 · 被引用 11 次
相关 Paper
- Online Submodular Maximization via Online Convex OptimizationTareq Si Salem, Gözde Özcan, Iasonas Nikolaou, Evimaria Terzi 等AAAI 2024 · 被引用 8 次
- No-Regret Learning for Fair Multi-Agent Social Welfare OptimizationMengxiao Zhang, Ramiro Deo-Campo Vuong, Haipeng LuoNeurIPS 2024 · 被引用 7 次
- Nearly Minimax Optimal Submodular Maximization with Bandit FeedbackArtin Tajdini, Lalit Jain, Kevin JamiesonNeurIPS 2024 · 被引用 9 次
- Gradient Methods for Online DR-Submodular Maximization with Stochastic Long-Term ConstraintsGuanyu Nie, Vaneet Aggarwal, Christopher J. QuinnNeurIPS 2024 · 被引用 1 次
- Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious FunctionQixin Zhang, Zengde Deng, Zaiyi Chen, Haoyuan Hu 等ICML 2022 · 被引用 25 次
