Learning general halfspaces with general Massart noise under the Gaussian distribution
Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos, Nikos Zarifis
Abstract
We study the problem of PAC learning halfspaces on R d with Massart noise under the Gaussian distribution. In the Massart model, an adversary is allowed to flip the label of each point x with unknown probability η(x) ≤ η, for some parameter η ∈ [0, 1/2]. The goal of the learner is to output a hypothesis with misclassification error of OPT + ǫ, where OPT is the error of the target halfspace. This problem had been previously studied under two assumptions: (i) the target halfspace is homogeneous (i.e., the separating hyperplane goes through the origin), and (ii) the parameter η is strictly smaller than 1/2. Prior to this work, no nontrivial bounds were known for the general case when either of these assumptions is removed. Here we study the general problem and establish the following results:
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 66e354b8-119a-48dc-9df0-b3d324e481f1Cited by top-tier papers16
- Tester-Learners for Halfspaces: Universal AlgorithmsAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanNeurIPS 2023 · 19 citations
- SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker AssumptionsIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2023 · 17 citations
- An Efficient Tester-Learner for HalfspacesAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanICLR 2024 · 16 citations
- ReLU Regression with Massart NoiseIlias Diakonikolas, Jongho Park, Christos TzamosNeurIPS 2021 · 14 citations
- Robust Learning of Multi-index Models via Iterative Subspace ApproximationIlias Diakonikolas, Giannis Iakovidis, Daniel M. Kane, Nikos ZarifisFOCS 2025 · 10 citations
Builds on4
- Near-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian MarginalsIlias Diakonikolas, Daniel Kane, Nikos ZarifisNeurIPS 2020 · 80 citations
- Statistical-Query Lower Bounds via Functional GradientsSurbhi Goel, Aravind Gollakota, Adam R. KlivansNeurIPS 2020 · 72 citations
- Efficient active learning of sparse halfspaces with arbitrary bounded noiseChicheng Zhang, Jie Shen, Pranjal AwasthiNeurIPS 2020 · 50 citations
- Efficiently learning halfspaces with Tsybakov noiseIlias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos et al.STOC 2021 · 2 citations
Related papers
- Cryptographic Hardness of Learning Halfspaces with Massart NoiseIlias Diakonikolas, Daniel Kane, Pasin Manurangsi, Lisheng RenNeurIPS 2022 · 35 citations
- Learning Noisy Halfspaces with a Margin: Massart is No Harder than RandomGautam Chandrasekaran, Vasilis Kontonis, Konstantinos Stavropoulos, Kevin TianNeurIPS 2024 · 8 citations
- A Near-optimal Algorithm for Learning Margin Halfspaces with Massart NoiseIlias Diakonikolas, Nikos ZarifisNeurIPS 2024 · 8 citations
- SQ Lower Bounds for Learning Single Neurons with Massart NoiseIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2022 · 8 citations
- Classification Under Misspecification: Halfspaces, Generalized Linear Models, and EvolvabilitySitan Chen, Frederic Koehler, Ankur Moitra, Morris YauNeurIPS 2020 · 28 citations
