SoS Certifiability of Subgaussian Distributions and Its Algorithmic Applications
Ilias Diakonikolas, Samuel B. Hopkins, Ankit Pensia, Stefan Tiegel
摘要
We prove that there is a universal constant C>0 so that for every d ∈ ℕ, every centered subgaussian distribution D on ℝd, and every even p ∈ ℕ, the d-variate polynomial (Cp)p/2 · ||v||2p − EX ∼ D ⟨ v,X⟩p is a sum of square polynomials. This establishes that every subgaussian distribution is SoS-certifiably subgaussian—a condition that yields efficient learning algorithms for a wide variety of high-dimensional statistical tasks. As a direct corollary, we obtain computationally efficient algorithms with near-optimal guarantees for the following tasks, when given samples from an arbitrary subgaussian distribution: robust mean estimation, list-decodable mean estimation, clustering mean-separated mixture models, robust covariance-aware mean estimation, robust covariance estimation, and robust linear regression. Our proof makes essential use of Talagrand’s generic chaining/majorizing measures theorem.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- The Power of Iterative Filtering for Supervised Learning with (Heavy) ContaminationAdam R. Klivans, Konstantinos Stavropoulos, Kevin Tian, Arsen VasilyanNeurIPS 2025 · 被引用 8 次
- Sparsifying Suprema of Gaussian ProcessesAnindya De, Shivam Nadimpalli, Ryan O'Donnell, Rocco A. ServedioSTOC 2026 · 被引用 3 次
- Outlier-robust Mean Estimation near the Breakdown Point via Sum-of-SquaresHongjie Chen, Deepak Narayanan Sridharan, David SteurerSODA 2025 · 被引用 1 次
- SoS Certificates for Sparse Singular Values and Their Applications: Robust Statistics, Subspace Distortion, and MoreIlias Diakonikolas, Samuel B. Hopkins, Ankit Pensia, Stefan TiegelSTOC 2025 · 被引用 1 次
- Learning Mixture Models via Efficient High-Dimensional Sparse Fourier TransformsAlkis Kalavasis, Pravesh K. Kothari, Shuchen Li, Manolis ZampetakisSTOC 2026 · 被引用 1 次
它引用的顶会 Paper9
- Statistical Query Lower Bounds for List-Decodable Linear RegressionIlias Diakonikolas, Daniel Kane, Ankit Pensia, Thanasis Pittas 等NeurIPS 2021 · 被引用 28 次
- Tester-Learners for Halfspaces: Universal AlgorithmsAravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen VasilyanNeurIPS 2023 · 被引用 19 次
- Robust Regression Revisited: Acceleration and Improved Estimation RatesArun Jambulapati, Jerry Li, Tselil Schramm, Kevin TianNeurIPS 2021 · 被引用 18 次
- SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker AssumptionsIlias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin SunNeurIPS 2023 · 被引用 17 次
- List-Decodable Sparse Mean Estimation via Difference-of-Pairs FilteringIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia 等NeurIPS 2022 · 被引用 16 次
相关 Paper
- Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanismSamuel B. Hopkins, Gautam Kamath, Mahbod MajidSTOC 2022 · 被引用 20 次
- List-decodable covariance estimationMisha Ivkov, Pravesh K. KothariSTOC 2022 · 被引用 5 次
- Efficient Certificates of Anti-Concentration Beyond GaussiansAinesh Bakshi, Pravesh K. Kothari, Goutham Rajendran, Madhur Tulsiani 等FOCS 2024 · 被引用 1 次
- Robustly learning mixtures of k arbitrary GaussiansAinesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane 等STOC 2022 · 被引用 21 次
- Robust Mean Estimation Without Moments for Symmetric DistributionsGleb Novikov, David Steurer, Stefan TiegelNeurIPS 2023
