On Learning Parallel Pancakes with Mostly Uniform Weights
Ilias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Jasper C. H. Lee, Thanasis Pittas
摘要
We study the complexity of learning k-mixtures of Gaussians (k-GMMs) on R d . This task is known to have complexity d Ω(k) in full generality. To circumvent this exponential lower bound on the number of components, research has focused on learning families of GMMs satisfying additional structural properties. A natural assumption posits that the component weights are not exponentially small and that the components have the same unknown covariance. Recent work gave a d O(log(1/wmin)) -time algorithm for this class of GMMs, where w min is the minimum weight. Our first main result is a Statistical Query (SQ) lower bound showing that this quasi-polynomial upper bound is essentially best possible, even for the special case of uniform weights. Specifically, we show that it is SQ-hard to distinguish between such a mixture and the standard Gaussian. We further explore how the distribution of weights affects the complexity of this task. Our second main result is a quasi-polynomial upper bound for the aforementioned testing task when most of the weights are uniform while a small fraction of the weights are potentially arbitrary.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Robustly learning mixtures of k arbitrary GaussiansAinesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane 等STOC 2022 · 被引用 21 次
- SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker AssumptionsIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2023 · 被引用 17 次
- Continuous LWE is as Hard as LWE & Applications to Learning Gaussian MixturesAparna Gupte, Neekon Vafa, Vinod VaikuntanathanFOCS 2022 · 被引用 15 次
- Settling the robust learnability of mixtures of GaussiansAllen Liu, Ankur MoitraSTOC 2021 · 被引用 14 次
- Outlier-Robust Clustering of Gaussians and Other Non-Spherical MixturesAinesh Bakshi, Ilias Diakonikolas, Samuel B. Hopkins, Daniel Kane 等FOCS 2020 · 被引用 13 次
相关 Paper
- SQ Lower Bounds for Learning Mixtures of Linear ClassifiersIlias Diakonikolas, Daniel Kane, Yuxin SunNeurIPS 2023 · 被引用 4 次
- Sum-of-Squares Lower Bounds for Non-Gaussian Component AnalysisIlias Diakonikolas, Sushrut Karmalkar, Shuo Pang, Aaron PotechinFOCS 2024 · 被引用 1 次
- Polynomial Time and Private Learning of Unbounded Gaussian Mixture ModelsJamil Arbas, Hassan Ashtiani, Christopher LiawICML 2023 · 被引用 32 次
- Superpolynomial Lower Bounds for Learning One-Layer Neural Networks using Gradient DescentSurbhi Goel, Aravind Gollakota, Zhihan Jin, Sushrut Karmalkar 等ICML 2020 · 被引用 75 次
- A Fourier Approach to Mixture LearningMingda Qiao, Guru Guruganesh, Ankit Singh Rawat, Kumar Avinava Dubey 等NeurIPS 2022 · 被引用 7 次
