Efficient Testable Learning of Halfspaces with Adversarial Label Noise
Ilias Diakonikolas, Daniel Kane, Vasilis Kontonis, Sihan Liu, Nikos Zarifis
Abstract
We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a tester-learner such that if the data passes the tester, then one can trust the output of the robust learner on the data. Our tester-learner runs in time and outputs a halfspace with misclassification error , where is the 0-1 error of the best fitting halfspace. At a technical level, our algorithm employs an iterative soft localization technique enhanced with appropriate testers to ensure that the data distribution is sufficiently similar to a Gaussian.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers13
- Tester-Learners for Halfspaces: Universal AlgorithmsAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanNeurIPS 2023 · 19 citations
- Tolerant Algorithms for Learning with Arbitrary Covariate ShiftSurbhi Goel, Abhishek Shetty, Konstantinos Stavropoulos, Arsen VasilyanNeurIPS 2024 · 17 citations
- Testably Learning Polynomial Threshold FunctionsLucas Slot, Stefan Tiegel, Manuel WiedmerNeurIPS 2024 · 13 citations
- Efficient Discrepancy Testing for Learning with Distribution ShiftGautam Chandrasekaran, Adam R. Klivans, Vasilis Kontonis, Konstantinos Stavropoulos et al.NeurIPS 2024 · 10 citations
- The Power of Iterative Filtering for Supervised Learning with (Heavy) ContaminationAdam R. Klivans, Konstantinos Stavropoulos, Kevin Tian, Arsen VasilyanNeurIPS 2025 · 8 citations
Builds on8
- Near-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian MarginalsIlias Diakonikolas, Daniel Kane, Nikos ZarifisNeurIPS 2020 · 80 citations
- Statistical-Query Lower Bounds via Functional GradientsSurbhi Goel, Aravind Gollakota, Adam R. KlivansNeurIPS 2020 · 72 citations
- Near-Optimal Cryptographic Hardness of Agnostically Learning Halfspaces and ReLU Regression under Gaussian MarginalsIlias Diakonikolas, Daniel Kane, Lisheng RenICML 2023 · 40 citations
- Non-Convex SGD Learns Halfspaces with Adversarial Label NoiseIlias Diakonikolas, Vasilis Kontonis, Christos Tzamos, Nikos ZarifisNeurIPS 2020 · 38 citations
- Cryptographic Hardness of Learning Halfspaces with Massart NoiseIlias Diakonikolas, Daniel Kane, Pasin Manurangsi, Lisheng RenNeurIPS 2022 · 35 citations
Related papers
- An Efficient Tester-Learner for HalfspacesAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanICLR 2024 · 16 citations
- Efficiently Learning Adversarially Robust Halfspaces with NoiseOmar Montasser, Surbhi Goel, Ilias Diakonikolas, Nathan SrebroICML 2020 · 33 citations
- Learning General Halfspaces with Adversarial Label Noise via Online Gradient DescentIlias Diakonikolas, Vasilis Kontonis, Christos Tzamos, Nikos ZarifisICML 2022 · 18 citations
- Efficiently learning halfspaces with Tsybakov noiseIlias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos et al.STOC 2021 · 2 citations
- On the Power of Localized Perceptron for Label-Optimal Learning of Halfspaces with Adversarial NoiseJie ShenICML 2021 · 15 citations
