List-Decodable Sparse Mean Estimation
Shiwei Zeng, Jie Shen
Abstract
Robust mean estimation is one of the most important problems in statistics: given a set of samples in R d where an α fraction are drawn from some distribution D and the rest are adversarially corrupted, we aim to estimate the mean of D. A surge of recent research interest has been focusing on the list-decodable setting where α ∈ (0, 1 2 ], and the goal is to output a finite number of estimates among which at least one approximates the target mean. In this paper, we consider that the underlying distribution D is Gaussian with k-sparse mean. Our main contribution is the first polynomial-time algorithm that enjoys sample complexity O poly(k, log d) , i.e. poly-logarithmic in the dimension. One of our core algorithmic ingredients is using low-degree sparse polynomials to filter outliers, which may find more applications. Learning with overwhelming corruption (α ≤ 1/2). The agnostic label noise of [Hau92, KSS92] seems the earliest model that allows the adversary to arbitrarily corrupt any fraction of
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d56cbf5-d573-4575-8d2d-3e05d81f11efCited by top-tier papers5
- The Power of Iterative Filtering for Supervised Learning with (Heavy) ContaminationAdam R. Klivans, Konstantinos Stavropoulos, Kevin Tian, Arsen VasilyanNeurIPS 2025 · 8 citations
- Robust Mixture Learning when Outliers Overwhelm Small GroupsDaniil Dmitriev, Rares-Darius Buhai, Stefan Tiegel, Alexander Wolters et al.NeurIPS 2024 · 2 citations
- A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius NormIlias Diakonikolas, Daniel Kane, Jasper C. H. Lee, Ankit Pensia et al.NeurIPS 2023 · 1 citation
- Robust Sparse Estimation for Gaussians with Optimal Error under Huber ContaminationIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.ICML 2024 · 1 citation
- Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty NoiseShiwei Zeng, Jie ShenICML 2023 · 1 citation
Builds on11
- Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret MinimizationSamuel B. Hopkins, Jerry Li, Fred ZhangNeurIPS 2020 · 74 citations
- Efficient active learning of sparse halfspaces with arbitrary bounded noiseChicheng Zhang, Jie Shen, Pranjal AwasthiNeurIPS 2020 · 50 citations
- List Decodable Learning via Sum of SquaresPrasad Raghavendra, Morris YauSODA 2020 · 44 citations
- List-Decodable Mean Estimation via Iterative Multi-FilteringIlias Diakonikolas, Daniel Kane, Daniel KongsgaardNeurIPS 2020 · 23 citations
- Outlier-Robust Sparse Estimation via Non-Convex OptimizationYu Cheng, Ilias Diakonikolas, Rong Ge, Shivam Gupta et al.NeurIPS 2022 · 19 citations
Related papers
- List-Decodable Sparse Mean Estimation via Difference-of-Pairs FilteringIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.NeurIPS 2022 · 16 citations
- List Decodable Mean Estimation in Nearly Linear TimeYeshwanth Cherapanamjeri, Sidhanth Mohanty, Morris YauFOCS 2020 · 13 citations
- A Subquadratic Time Algorithm for Robust Sparse Mean EstimationAnkit PensiaICML 2024 · 1 citation
- List-Decodable Mean Estimation in Nearly-PCA TimeIlias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li et al.NeurIPS 2021 · 18 citations
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 5 citations
