No-Regret M♮-Concave Function Maximization: Stochastic Bandit Algorithms and NP-Hardness of Adversarial Full-Information Setting
Taihei Oki, Shinsaku Sakaue
Abstract
M-concave functions, a.k.a. gross substitute valuation functions, play a fundamental role in many fields, including discrete mathematics and economics. In practice, perfect knowledge of M-concave functions is often unavailable a priori, and we can optimize them only interactively based on some feedback. Motivated by such situations, we study online M-concave function maximization problems, which are interactive versions of the problem studied by Murota and Shioura (1999). For the stochastic bandit setting, we present -simple regret and -regret algorithms under times access to unbiased noisy value oracles of M-concave functions. A key to proving these results is the robustness of the greedy algorithm to local errors in M-concave function maximization, which is one of our main technical results. While we obtain those positive results for the stochastic setting, another main result of our work is an impossibility in the adversarial setting. We prove that, even with full-information feedback, no algorithms that run in polynomial time per round can achieve regret for any constant . Our proof is based on a reduction from the matroid intersection problem for three matroids, which would be a novel approach to establishing the hardness in online learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7fad7434-234e-4fa6-b883-94677127bdceCited by top-tier papers1
Ask how each one uses itBuilds on9
- Adversarial Combinatorial Bandits with General Non-linear Reward FunctionsYanjun Han, Yining Wang, Xi ChenICML 2021 · 19 citations
- Improved Algorithms for Online Submodular Maximization via First-order Regret BoundsNicholas J. A. Harvey, Christopher Liaw, Tasuku SomaNeurIPS 2020 · 17 citations
- A Framework for Adapting Offline Algorithms to Solve Combinatorial Multi-Armed Bandit Problems with Bandit FeedbackGuanyu Nie, Yididiya Y. Nadew, Yanhui Zhu, Vaneet Aggarwal et al.ICML 2023 · 17 citations
- Combinatorial Stochastic-Greedy BanditFares Fourati, Christopher John Quinn, Mohamed-Slim Alouini, Vaneet AggarwalAAAI 2024 · 14 citations
- Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular BanditsZongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun et al.ICML 2023 · 11 citations
Related papers
- Online Submodular Maximization via Online Convex OptimizationTareq Si Salem, Gözde Özcan, Iasonas Nikolaou, Evimaria Terzi et al.AAAI 2024 · 8 citations
- No-Regret Learning for Fair Multi-Agent Social Welfare OptimizationMengxiao Zhang, Ramiro Deo-Campo Vuong, Haipeng LuoNeurIPS 2024 · 7 citations
- Nearly Minimax Optimal Submodular Maximization with Bandit FeedbackArtin Tajdini, Lalit Jain, Kevin JamiesonNeurIPS 2024 · 9 citations
- Gradient Methods for Online DR-Submodular Maximization with Stochastic Long-Term ConstraintsGuanyu Nie, Vaneet Aggarwal, Christopher J. QuinnNeurIPS 2024 · 1 citation
- Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious FunctionQixin Zhang, Zengde Deng, Zaiyi Chen, Haoyuan Hu et al.ICML 2022 · 25 citations
