Smoothed Agnostic Learning of Halfspaces over the Hypercube
Yiwen Kou, Raghu Meka
Abstract
Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such hardness, but existing frameworks rely on additive Gaussian perturbations, making them unsuitable for discrete domains. We introduce a new smoothed agnostic learning framework for Boolean inputs, where perturbations are modeled via random bit flips. This defines a natural discrete analogue of smoothed optimality generalizing the Gaussian case. Under strictly subexponential assumptions on the input distribution, we give an efficient algorithm for learning halfspaces in this model, with runtime and sample complexity approximately n raised to a poly(1/(sigma * epsilon)) factor. Previously, such algorithms were known only with strong structural assumptions for the discrete hypercube, for example, independent coordinates or symmetric distributions. Our result provides the first computationally efficient guarantee for smoothed agnostic learning of halfspaces over the Boolean hypercube, bridging the gap between worst-case intractability and practical learnability in discrete settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 12262b6f-e741-4c62-b517-187720f5ae59Builds on1
Related papers
- Near-Optimal Cryptographic Hardness of Agnostically Learning Halfspaces and ReLU Regression under Gaussian MarginalsIlias Diakonikolas, Daniel Kane, Lisheng RenICML 2023 · 40 citations
- Reliable Learning of Halfspaces under Gaussian MarginalsIlias Diakonikolas, Lisheng Ren, Nikos ZarifisNeurIPS 2024 · 1 citation
- The Complexity of Adversarially Robust Proper Learning of Halfspaces with Agnostic NoiseIlias Diakonikolas, Daniel M. Kane, Pasin ManurangsiNeurIPS 2020 · 23 citations
- A Fully Polynomial-Time Algorithm for Robustly Learning Halfspaces over the HypercubeGautam Chandrasekaran, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanSTOC 2026 · 2 citations
- Agnostically Learning Multi-Index Models with QueriesIlias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos et al.FOCS 2024 · 2 citations
