List-Decodable Sparse Mean Estimation
Shiwei Zeng, Jie Shen
摘要
Robust mean estimation is one of the most important problems in statistics: given a set of samples in R d where an α fraction are drawn from some distribution D and the rest are adversarially corrupted, we aim to estimate the mean of D. A surge of recent research interest has been focusing on the list-decodable setting where α ∈ (0, 1 2 ], and the goal is to output a finite number of estimates among which at least one approximates the target mean. In this paper, we consider that the underlying distribution D is Gaussian with k-sparse mean. Our main contribution is the first polynomial-time algorithm that enjoys sample complexity O poly(k, log d) , i.e. poly-logarithmic in the dimension. One of our core algorithmic ingredients is using low-degree sparse polynomials to filter outliers, which may find more applications. Learning with overwhelming corruption (α ≤ 1/2). The agnostic label noise of [Hau92, KSS92] seems the earliest model that allows the adversary to arbitrarily corrupt any fraction of
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- The Power of Iterative Filtering for Supervised Learning with (Heavy) ContaminationAdam R. Klivans, Konstantinos Stavropoulos, Kevin Tian, Arsen VasilyanNeurIPS 2025 · 被引用 8 次
- Robust Mixture Learning when Outliers Overwhelm Small GroupsDaniil Dmitriev, Rares-Darius Buhai, Stefan Tiegel, Alexander Wolters 等NeurIPS 2024 · 被引用 2 次
- A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius NormIlias Diakonikolas, Daniel Kane, Jasper C. H. Lee, Ankit Pensia 等NeurIPS 2023 · 被引用 1 次
- Robust Sparse Estimation for Gaussians with Optimal Error under Huber ContaminationIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia 等ICML 2024 · 被引用 1 次
- Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty NoiseShiwei Zeng, Jie ShenICML 2023 · 被引用 1 次
它引用的顶会 Paper11
- Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret MinimizationSamuel B. Hopkins, Jerry Li, Fred ZhangNeurIPS 2020 · 被引用 74 次
- Efficient active learning of sparse halfspaces with arbitrary bounded noiseChicheng Zhang, Jie Shen, Pranjal AwasthiNeurIPS 2020 · 被引用 50 次
- List Decodable Learning via Sum of SquaresPrasad Raghavendra, Morris YauSODA 2020 · 被引用 44 次
- List-Decodable Mean Estimation via Iterative Multi-FilteringIlias Diakonikolas, Daniel Kane, Daniel KongsgaardNeurIPS 2020 · 被引用 23 次
- Outlier-Robust Sparse Estimation via Non-Convex OptimizationYu Cheng, Ilias Diakonikolas, Rong Ge, Shivam Gupta 等NeurIPS 2022 · 被引用 19 次
相关 Paper
- List-Decodable Sparse Mean Estimation via Difference-of-Pairs FilteringIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia 等NeurIPS 2022 · 被引用 16 次
- List Decodable Mean Estimation in Nearly Linear TimeYeshwanth Cherapanamjeri, Sidhanth Mohanty, Morris YauFOCS 2020 · 被引用 13 次
- A Subquadratic Time Algorithm for Robust Sparse Mean EstimationAnkit PensiaICML 2024 · 被引用 1 次
- List-Decodable Mean Estimation in Nearly-PCA TimeIlias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li 等NeurIPS 2021 · 被引用 18 次
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 被引用 5 次
