Smoothed Agnostic Learning of Halfspaces over the Hypercube
Yiwen Kou, Raghu Meka
摘要
Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such hardness, but existing frameworks rely on additive Gaussian perturbations, making them unsuitable for discrete domains. We introduce a new smoothed agnostic learning framework for Boolean inputs, where perturbations are modeled via random bit flips. This defines a natural discrete analogue of smoothed optimality generalizing the Gaussian case. Under strictly subexponential assumptions on the input distribution, we give an efficient algorithm for learning halfspaces in this model, with runtime and sample complexity approximately n raised to a poly(1/(sigma * epsilon)) factor. Previously, such algorithms were known only with strong structural assumptions for the discrete hypercube, for example, independent coordinates or symmetric distributions. Our result provides the first computationally efficient guarantee for smoothed agnostic learning of halfspaces over the Boolean hypercube, bridging the gap between worst-case intractability and practical learnability in discrete settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper1
相关 Paper
- Near-Optimal Cryptographic Hardness of Agnostically Learning Halfspaces and ReLU Regression under Gaussian MarginalsIlias Diakonikolas, Daniel Kane, Lisheng RenICML 2023 · 被引用 40 次
- Reliable Learning of Halfspaces under Gaussian MarginalsIlias Diakonikolas, Lisheng Ren, Nikos ZarifisNeurIPS 2024 · 被引用 1 次
- The Complexity of Adversarially Robust Proper Learning of Halfspaces with Agnostic NoiseIlias Diakonikolas, Daniel M. Kane, Pasin ManurangsiNeurIPS 2020 · 被引用 23 次
- A Fully Polynomial-Time Algorithm for Robustly Learning Halfspaces over the HypercubeGautam Chandrasekaran, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanSTOC 2026 · 被引用 2 次
- Agnostically Learning Multi-Index Models with QueriesIlias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos 等FOCS 2024 · 被引用 2 次
