On the Learning Curves of Revenue Maximization
Steve Hanneke, Alkis Kalavasis, Shay Moran, Grigoris Velegkas
摘要
Learning curves are a fundamental primitive in supervised learning, describing how an algorithm's performance improves with more data and providing a quantitative measure of its generalization ability. Formally, a learning curve plots the decay of an algorithm's error for a fixed underlying distribution as a function of the number of training samples. Prior work on revenue-maximizing learning algorithms, starting with the seminal work of Cole and Roughgarden (2014, STOC), adopts a distribution-free perspective (which parallels the PAC learning framework in learning theory). This approach evaluates performance against the hardest possible sequence of valuation distributions, one for each sample size, effectively defining the upper envelope of learning curves over all possible distributions, thus leading to error bounds that do not capture the shape of the learning curves.
In this work we initiate the study of learning curves for revenue maximization and we provide a near-complete characterization of their rate of decay in the basic setting of a single item and a single buyer. In the absence of any restriction on the valuation distribution, we show that there exists a Bayes-consistent algorithm, meaning its learning curve converges to zero for any arbitrary valuation distribution as the number of samples n → ∞. However, this convergence must be arbitrarily slow, even if the optimal revenue is finite. In contrast, if the optimal revenue is achieved by a finite price then the optimal rate of decay is roughly 1/ √ n. Finally, for distributions supported on discrete sets of values, we show that learning curves decay (almost) exponentially fast, a rate unattainable under the PAC framework.
From a technical perspective, establishing lower bounds on learning curves is significantly more challenging than in the PAC framework, as it requires fixing a single hard distribution and proving a bound that holds for infinitely many values of n. Conversely, deriving upper bounds involves non-trivial algorithmic principles, including techniques such as regularization and structural risk minimization, which are crucial for achieving optimal learning rates.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper6
- Multiclass Learnability Beyond the PAC Framework: Universal Rates and Partial Concept ClassesAlkis Kalavasis, Grigoris Velegkas, Amin KarbasiNeurIPS 2022 · 被引用 16 次
- Universal Rates for Interactive LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2022 · 被引用 7 次
- Universal Rates of Empirical Risk MinimizationSteve Hanneke, Mingyue XuNeurIPS 2024 · 被引用 4 次
- Universal Rates for Active LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2024 · 被引用 3 次
- On the Limits of Language Generation: Trade-Offs between Hallucination and Mode-CollapseAlkis Kalavasis, Anay Mehrotra, Grigoris VelegkasSTOC 2025 · 被引用 2 次
相关 Paper
- A theory of universal learningOlivier Bousquet, Steve Hanneke, Shay Moran, Ramon van Handel 等STOC 2021
- Optimal Pricing Schemes for an Impatient BuyerYuan Deng, Jieming Mao, Balasubramanian Sivan, Kangning WangSODA 2023
- Learning to Price Homogeneous DataKeran Chen, Joon Suk Huh, Kirthevasan KandasamyNeurIPS 2024 · 被引用 5 次
- Robust Learning of Optimal AuctionsWenshuo Guo, Michael I. Jordan, Emmanouil ZampetakisNeurIPS 2021 · 被引用 4 次
- A Limitation of the PAC-Bayes FrameworkRoi Livni, Shay MoranNeurIPS 2020 · 被引用 26 次
