Robustly learning mixtures of k arbitrary Gaussians
Ainesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane, Pravesh K. Kothari, Santosh S. Vempala
Abstract
We give a polynomial-time algorithm for the problem of robustly estimating a mixture of arbitrary Gaussians in ℝ , for any fixed , in the presence of a constant fraction of arbitrary corruptions. This resolves the main open problem in several previous works on algorithmic robust statistics, which addressed the special cases of robustly estimating (a) a single Gaussian, (b) a mixture of TV-distance separated Gaussians, and (c) a uniform mixture of two Gaussians. Our main tools are an efficient partial clustering algorithm that relies on the sum-of-squares method, and a novel tensor decomposition algorithm that allows errors in both Frobenius norm and low-rank terms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d4dfc751-5568-419c-bfc0-c3bcb7a6873eCited by top-tier papers35
- Learning Mixtures of Gaussians Using the DDPM ObjectiveKulin Shah, Sitan Chen, Adam R. KlivansNeurIPS 2023 · 69 citations
- Private estimation algorithms for stochastic block models and mixture modelsHongjie Chen, Vincent Cohen-Addad, Tommaso d'Orsi, Alessandro Epasto et al.NeurIPS 2023 · 34 citations
- Polynomial Time and Private Learning of Unbounded Gaussian Mixture ModelsJamil Arbas, Hassan Ashtiani, Christopher LiawICML 2023 · 32 citations
- Streaming Algorithms for High-Dimensional Robust StatisticsIlias Diakonikolas, Daniel M. Kane, Ankit Pensia, Thanasis PittasICML 2022 · 25 citations
- Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture PerspectiveYingyu Liang, Zhizhou Sha, Zhenmei Shi, Zhao Song et al.ICCV 2025 · 23 citations
Builds on7
- List Decodable Learning via Sum of SquaresPrasad Raghavendra, Morris YauSODA 2020 · 44 citations
- High-dimensional Robust Mean Estimation via Gradient DescentYu Cheng, Ilias Diakonikolas, Rong Ge, Mahdi SoltanolkotabiICML 2020 · 33 citations
- List-Decodable Subspace Recovery: Dimension Independent Error in Polynomial TimeAinesh Bakshi, Pravesh K. KothariSODA 2021 · 17 citations
- Settling the robust learnability of mixtures of GaussiansAllen Liu, Ankur MoitraSTOC 2021 · 14 citations
- Robust linear regression: optimal rates in polynomial timeAinesh Bakshi, Adarsh PrasadSTOC 2021 · 13 citations
Related papers
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 5 citations
- Robust Learning of Mixtures of GaussiansDaniel M. KaneSODA 2021 · 12 citations
- A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius NormIlias Diakonikolas, Daniel Kane, Jasper C. H. Lee, Ankit Pensia et al.NeurIPS 2023 · 1 citation
- Outlier-Robust Clustering of Gaussians and Other Non-Spherical MixturesAinesh Bakshi, Ilias Diakonikolas, Samuel B. Hopkins, Daniel Kane et al.FOCS 2020 · 13 citations
- Polynomial-Time Power-Sum Decomposition of PolynomialsMitali Bafna, Jun-Ting Hsieh, Pravesh K. Kothari, Jeff XuFOCS 2022 · 4 citations
