Lune

NeurIPS2024Top-tier venue

No-Regret M♮-Concave Function Maximization: Stochastic Bandit Algorithms and NP-Hardness of Adversarial Full-Information Setting

Taihei Oki, Shinsaku Sakaue

2024Year
2Citations
1Top-tier citations

Abstract

M♮{}^{\natural}-concave functions, a.k.a. gross substitute valuation functions, play a fundamental role in many fields, including discrete mathematics and economics. In practice, perfect knowledge of M♮{}^{\natural}-concave functions is often unavailable a priori, and we can optimize them only interactively based on some feedback. Motivated by such situations, we study online M♮{}^{\natural}-concave function maximization problems, which are interactive versions of the problem studied by Murota and Shioura (1999). For the stochastic bandit setting, we present O(T−1/2)O(T^{-1/2})-simple regret and O(T2/3)O(T^{2/3})-regret algorithms under TT times access to unbiased noisy value oracles of M♮{}^{\natural}-concave functions. A key to proving these results is the robustness of the greedy algorithm to local errors in M♮{}^{\natural}-concave function maximization, which is one of our main technical results. While we obtain those positive results for the stochastic setting, another main result of our work is an impossibility in the adversarial setting. We prove that, even with full-information feedback, no algorithms that run in polynomial time per round can achieve O(T1−c)O(T^{1-c}) regret for any constant c>0c>0. Our proof is based on a reduction from the matroid intersection problem for three matroids, which would be a novel approach to establishing the hardness in online learning.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 7fad7434-234e-4fa6-b883-94677127bdce

Cited by top-tier papers1

Ask how each one uses it

Builds on9

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines