On the Learning Curves of Revenue Maximization
Steve Hanneke, Alkis Kalavasis, Shay Moran, Grigoris Velegkas
Abstract
Learning curves are a fundamental primitive in supervised learning, describing how an algorithm's performance improves with more data and providing a quantitative measure of its generalization ability. Formally, a learning curve plots the decay of an algorithm's error for a fixed underlying distribution as a function of the number of training samples. Prior work on revenue-maximizing learning algorithms, starting with the seminal work of Cole and Roughgarden (2014, STOC), adopts a distribution-free perspective (which parallels the PAC learning framework in learning theory). This approach evaluates performance against the hardest possible sequence of valuation distributions, one for each sample size, effectively defining the upper envelope of learning curves over all possible distributions, thus leading to error bounds that do not capture the shape of the learning curves.
In this work we initiate the study of learning curves for revenue maximization and we provide a near-complete characterization of their rate of decay in the basic setting of a single item and a single buyer. In the absence of any restriction on the valuation distribution, we show that there exists a Bayes-consistent algorithm, meaning its learning curve converges to zero for any arbitrary valuation distribution as the number of samples n → ∞. However, this convergence must be arbitrarily slow, even if the optimal revenue is finite. In contrast, if the optimal revenue is achieved by a finite price then the optimal rate of decay is roughly 1/ √ n. Finally, for distributions supported on discrete sets of values, we show that learning curves decay (almost) exponentially fast, a rate unattainable under the PAC framework.
From a technical perspective, establishing lower bounds on learning curves is significantly more challenging than in the PAC framework, as it requires fixing a single hard distribution and proving a bound that holds for infinitely many values of n. Conversely, deriving upper bounds involves non-trivial algorithmic principles, including techniques such as regularization and structural risk minimization, which are crucial for achieving optimal learning rates.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4ba9c336-e121-4b45-b4be-d9f4a8f38273Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Multiclass Learnability Beyond the PAC Framework: Universal Rates and Partial Concept ClassesAlkis Kalavasis, Grigoris Velegkas, Amin KarbasiNeurIPS 2022 · 16 citations
- Universal Rates for Interactive LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2022 · 7 citations
- Universal Rates of Empirical Risk MinimizationSteve Hanneke, Mingyue XuNeurIPS 2024 · 4 citations
- Universal Rates for Active LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2024 · 3 citations
- On the Limits of Language Generation: Trade-Offs between Hallucination and Mode-CollapseAlkis Kalavasis, Anay Mehrotra, Grigoris VelegkasSTOC 2025 · 2 citations
Related papers
- A theory of universal learningOlivier Bousquet, Steve Hanneke, Shay Moran, Ramon van Handel et al.STOC 2021
- Optimal Pricing Schemes for an Impatient BuyerYuan Deng, Jieming Mao, Balasubramanian Sivan, Kangning WangSODA 2023
- Learning to Price Homogeneous DataKeran Chen, Joon Suk Huh, Kirthevasan KandasamyNeurIPS 2024 · 5 citations
- Robust Learning of Optimal AuctionsWenshuo Guo, Michael I. Jordan, Emmanouil ZampetakisNeurIPS 2021 · 4 citations
- A Limitation of the PAC-Bayes FrameworkRoi Livni, Shay MoranNeurIPS 2020 · 26 citations
