On Learning Parallel Pancakes with Mostly Uniform Weights
Ilias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Jasper C. H. Lee, Thanasis Pittas
Abstract
We study the complexity of learning k-mixtures of Gaussians (k-GMMs) on R d . This task is known to have complexity d Ω(k) in full generality. To circumvent this exponential lower bound on the number of components, research has focused on learning families of GMMs satisfying additional structural properties. A natural assumption posits that the component weights are not exponentially small and that the components have the same unknown covariance. Recent work gave a d O(log(1/wmin)) -time algorithm for this class of GMMs, where w min is the minimum weight. Our first main result is a Statistical Query (SQ) lower bound showing that this quasi-polynomial upper bound is essentially best possible, even for the special case of uniform weights. Specifically, we show that it is SQ-hard to distinguish between such a mixture and the standard Gaussian. We further explore how the distribution of weights affects the complexity of this task. Our second main result is a quasi-polynomial upper bound for the aforementioned testing task when most of the weights are uniform while a small fraction of the weights are potentially arbitrary.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d84941e6-9cf6-4342-842b-9178803d404eBuilds on10
- Robustly learning mixtures of k arbitrary GaussiansAinesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane et al.STOC 2022 · 21 citations
- SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker AssumptionsIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2023 · 17 citations
- Continuous LWE is as Hard as LWE & Applications to Learning Gaussian MixturesAparna Gupte, Neekon Vafa, Vinod VaikuntanathanFOCS 2022 · 15 citations
- Settling the robust learnability of mixtures of GaussiansAllen Liu, Ankur MoitraSTOC 2021 · 14 citations
- Outlier-Robust Clustering of Gaussians and Other Non-Spherical MixturesAinesh Bakshi, Ilias Diakonikolas, Samuel B. Hopkins, Daniel Kane et al.FOCS 2020 · 13 citations
Related papers
- SQ Lower Bounds for Learning Mixtures of Linear ClassifiersIlias Diakonikolas, Daniel Kane, Yuxin SunNeurIPS 2023 · 4 citations
- Sum-of-Squares Lower Bounds for Non-Gaussian Component AnalysisIlias Diakonikolas, Sushrut Karmalkar, Shuo Pang, Aaron PotechinFOCS 2024 · 1 citation
- Polynomial Time and Private Learning of Unbounded Gaussian Mixture ModelsJamil Arbas, Hassan Ashtiani, Christopher LiawICML 2023 · 32 citations
- Superpolynomial Lower Bounds for Learning One-Layer Neural Networks using Gradient DescentSurbhi Goel, Aravind Gollakota, Zhihan Jin, Sushrut Karmalkar et al.ICML 2020 · 75 citations
- A Fourier Approach to Mixture LearningMingda Qiao, Guru Guruganesh, Ankit Singh Rawat, Kumar Avinava Dubey et al.NeurIPS 2022 · 7 citations
