SoS Certifiability of Subgaussian Distributions and Its Algorithmic Applications
Ilias Diakonikolas, Samuel B. Hopkins, Ankit Pensia, Stefan Tiegel
Abstract
We prove that there is a universal constant C>0 so that for every d ∈ ℕ, every centered subgaussian distribution D on ℝd, and every even p ∈ ℕ, the d-variate polynomial (Cp)p/2 · ||v||2p − EX ∼ D ⟨ v,X⟩p is a sum of square polynomials. This establishes that every subgaussian distribution is SoS-certifiably subgaussian—a condition that yields efficient learning algorithms for a wide variety of high-dimensional statistical tasks. As a direct corollary, we obtain computationally efficient algorithms with near-optimal guarantees for the following tasks, when given samples from an arbitrary subgaussian distribution: robust mean estimation, list-decodable mean estimation, clustering mean-separated mixture models, robust covariance-aware mean estimation, robust covariance estimation, and robust linear regression. Our proof makes essential use of Talagrand’s generic chaining/majorizing measures theorem.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext caa5de5c-0eeb-4d58-800a-78a30855332fCited by top-tier papers7
- The Power of Iterative Filtering for Supervised Learning with (Heavy) ContaminationAdam R. Klivans, Konstantinos Stavropoulos, Kevin Tian, Arsen VasilyanNeurIPS 2025 · 8 citations
- Sparsifying Suprema of Gaussian ProcessesAnindya De, Shivam Nadimpalli, Ryan O'Donnell, Rocco A. ServedioSTOC 2026 · 3 citations
- Outlier-robust Mean Estimation near the Breakdown Point via Sum-of-SquaresHongjie Chen, Deepak Narayanan Sridharan, David SteurerSODA 2025 · 1 citation
- SoS Certificates for Sparse Singular Values and Their Applications: Robust Statistics, Subspace Distortion, and MoreIlias Diakonikolas, Samuel B. Hopkins, Ankit Pensia, Stefan TiegelSTOC 2025 · 1 citation
- Learning Mixture Models via Efficient High-Dimensional Sparse Fourier TransformsAlkis Kalavasis, Pravesh K. Kothari, Shuchen Li, Manolis ZampetakisSTOC 2026 · 1 citation
Builds on9
- Statistical Query Lower Bounds for List-Decodable Linear RegressionIlias Diakonikolas, Daniel Kane, Ankit Pensia, Thanasis Pittas et al.NeurIPS 2021 · 28 citations
- Tester-Learners for Halfspaces: Universal AlgorithmsAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanNeurIPS 2023 · 19 citations
- Robust Regression Revisited: Acceleration and Improved Estimation RatesArun Jambulapati, Jerry Li, Tselil Schramm, Kevin TianNeurIPS 2021 · 18 citations
- SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker AssumptionsIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2023 · 17 citations
- List-Decodable Sparse Mean Estimation via Difference-of-Pairs FilteringIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.NeurIPS 2022 · 16 citations
Related papers
- Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanismSamuel B. Hopkins, Gautam Kamath, Mahbod MajidSTOC 2022 · 20 citations
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 5 citations
- Efficient Certificates of Anti-Concentration Beyond GaussiansAinesh Bakshi, Pravesh K. Kothari, Goutham Rajendran, Madhur Tulsiani et al.FOCS 2024 · 1 citation
- Robustly learning mixtures of k arbitrary GaussiansAinesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane et al.STOC 2022 · 21 citations
- Robust Mean Estimation Without Moments for Symmetric DistributionsGleb Novikov, David Steurer, Stefan TiegelNeurIPS 2023
