Learning Partial Concept Classes and Universal Rates Under Massart Noise
Ariel Avital, Klim Efremenko, Steve Hanneke
Abstract
The Massart noise condition is a central model in Probably Approximately Correct (PAC) learning theory. Its importance lies in it being an interpolation condition between realizable and the agnostic settings, under which one can attain faster rates than in the latter, and, under strict conditions, recover the rates of the former. Despite its importance, the Massart condition has not yet been fully explored in emerging extensions of statistical learning theory beyond the classical PAC framework. In this work, we present two such extensions. First, we revisit the transductive empirical risk minimization (TERM) algorithm of (Hanneke & Moran, 2026), and derive sharper excess error bounds under Massart noise using offset Rademacher techniques and local metric entropy introduced by (Zhivotovskiy & Hanneke, 2018). We then leverage this analysis to obtain new sample complexity bounds for PAC learning with partial concept classes and complete the characterization of universal rates under Massart noise.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 240b8793-79a0-4919-8ea4-6e4d0f17e9d1Builds on7
- Multiclass Learnability Beyond the PAC Framework: Universal Rates and Partial Concept ClassesAlkis Kalavasis, Grigoris Velegkas, Amin KarbasiNeurIPS 2022 · 16 citations
- A Theory of PAC Learnability of Partial Concept ClassesNoga Alon, Steve Hanneke, Ron Holzman, Shay MoranFOCS 2021 · 11 citations
- Universal Rates for Interactive LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2022 · 7 citations
- Universal Rates of Empirical Risk MinimizationSteve Hanneke, Mingyue XuNeurIPS 2024 · 4 citations
- Universal Rates for Active LearningSteve Hanneke, Amin Karbasi, Shay Moran, Grigoris VelegkasNeurIPS 2024 · 3 citations
Related papers
- Learning Noisy Halfspaces with a Margin: Massart is No Harder than RandomGautam Chandrasekaran, Vasilis Kontonis, Konstantinos Stavropoulos, Kevin TianNeurIPS 2024 · 8 citations
- Learning general halfspaces with general Massart noise under the Gaussian distributionIlias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos et al.STOC 2022 · 5 citations
- Revisiting Agnostic PAC LearningSteve Hanneke, Kasper Green Larsen, Nikita ZhivotovskiyFOCS 2024 · 1 citation
- On Agnostic PAC Learning in the Small Error RegimeJulian Asilis, Mikael Møller Høgsgaard, Grigoris VelegkasNeurIPS 2025 · 6 citations
- Localization, Convexity, and Star AggregationSuhas VijaykumarNeurIPS 2021 · 10 citations
