List-Decodable Mean Estimation via Iterative Multi-Filtering
Ilias Diakonikolas, Daniel Kane, Daniel Kongsgaard
Abstract
We study the problem of list-decodable mean estimation for bounded covariance distributions. Specifically, we are given a set of points in with the promise that an unknown -fraction of points in , where , are drawn from an unknown mean and bounded covariance distribution , and no assumptions are made on the remaining points. The goal is to output a small list of hypothesis vectors such that at least one of them is close to the mean of . We give the first practically viable estimator for this problem. In more detail, our algorithm is sample and computationally efficient, and achieves information-theoretically near-optimal error. While the only prior algorithm for this setting inherently relied on the ellipsoid method, our algorithm is iterative and only uses spectral techniques. Our main technical innovation is the design of a soft outlier removal procedure for high-dimensional heavy-tailed datasets with a majority of outliers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers15
- Statistical Query Lower Bounds for List-Decodable Linear RegressionIlias Diakonikolas, Daniel Kane, Ankit Pensia, Thanasis Pittas et al.NeurIPS 2021 · 28 citations
- A Characterization of List LearnabilityMoses Charikar, Chirag PabbarajuSTOC 2023 · 25 citations
- List-Decodable Mean Estimation in Nearly-PCA TimeIlias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li et al.NeurIPS 2021 · 18 citations
- List-Decodable Sparse Mean Estimation via Difference-of-Pairs FilteringIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.NeurIPS 2022 · 16 citations
- Privately Learning Mixtures of Axis-Aligned GaussiansIshaq Aden-Ali, Hassan Ashtiani, Christopher LiawNeurIPS 2021 · 14 citations
Builds on2
Related papers
- Entangled Mean Estimation in High DimensionsIlias Diakonikolas, Daniel M. Kane, Sihan Liu, Thanasis PittasSTOC 2025 · 1 citation
- Clustering mixture models in almost-linear time via list-decodable mean estimationIlias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li et al.STOC 2022 · 6 citations
- High-Accuracy List-Decodable Mean EstimationZiyun Chen, Spencer Compton, Daniel M. Kane, Jerry LiSTOC 2026
- A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius NormIlias Diakonikolas, Daniel Kane, Jasper C. H. Lee, Ankit Pensia et al.NeurIPS 2023 · 1 citation
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 5 citations
