Outlier Robust Mean Estimation with Subgaussian Rates via Stability
Ilias Diakonikolas, Daniel M. Kane, Ankit Pensia
Abstract
We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust statistics literature and prove that, except with exponentially small failure probability, there exists a large fraction of the inliers satisfying this condition. As a corollary, it follows that a number of recently developed algorithms for robust mean estimation, including iterative filtering and non-convex gradient descent, give optimal error estimators with (near-)subgaussian rates. Previous analyses of these algorithms gave significantly suboptimal rates. As a corollary of our approach, we obtain the first computationally efficient algorithm with subgaussian rate for outlier-robust mean estimation in the strong contamination model under a finite covariance assumption. * Authors are in alphabetical order.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3b62d2c3-118c-4f83-844f-3b302f5de45aCited by top-tier papers24
- Is Out-of-Distribution Detection Learnable?Zhen Fang, Yixuan Li, Jie Lu, Jiahua Dong et al.NeurIPS 2022 · 188 citations
- Sample Selection with Uncertainty of Losses for Learning with Noisy LabelsXiaobo Xia, Tongliang Liu, Bo Han, Mingming Gong et al.ICLR 2022 · 139 citations
- Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret MinimizationSamuel B. Hopkins, Jerry Li, Fred ZhangNeurIPS 2020 · 74 citations
- Robust Policy Gradient against Strong Data CorruptionXuezhou Zhang, Yiding Chen, Xiaojin Zhu, Wen SunICML 2021 · 43 citations
- Streaming Algorithms for High-Dimensional Robust StatisticsIlias Diakonikolas, Daniel M. Kane, Ankit Pensia, Thanasis PittasICML 2022 · 25 citations
Builds on2
Related papers
- Outlier-Robust Sparse Mean Estimation for Heavy-Tailed DistributionsIlias Diakonikolas, Daniel Kane, Jasper C. H. Lee, Ankit PensiaNeurIPS 2022 · 15 citations
- Robust Sparse Estimation for Gaussians with Optimal Error under Huber ContaminationIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.ICML 2024 · 1 citation
- Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear RegressionIlias Diakonikolas, Daniel Kane, Ankit Pensia, Thanasis PittasNeurIPS 2023 · 9 citations
- Efficient Multivariate Robust Mean Estimation Under Mean-Shift ContaminationIlias Diakonikolas, Giannis Iakovidis, Daniel Kane, Thanasis PittasICML 2025
- Robust Mean Estimation Without Moments for Symmetric DistributionsGleb Novikov, David Steurer, Stefan TiegelNeurIPS 2023
