Private estimation algorithms for stochastic block models and mixture models
Hongjie Chen, Vincent Cohen-Addad, Tommaso d'Orsi, Alessandro Epasto, Jacob Imola, David Steurer, Stefan Tiegel
Abstract
We introduce general tools for designing efficient private estimation algorithms, in the high-dimensional settings, whose statistical guarantees almost match those of the best known non-private algorithms. To illustrate our techniques, we consider two problems: recovery of stochastic block models and learning mixtures of spherical Gaussians. For the former, we present the first efficient ( , )-differentially private algorithms for both weak recovery and exact recovery. Previously known algorithms achieving comparable guarantees required quasi-polynomial time. We complement these results with an information-theoretic lower bound that highlights how the guarantees of our algorithms are almost tight. For the latter, we design an ( , )-differentially private algorithm that recovers the centers of the -mixture when the minimum separation is at least ( 1/ √ ). For all choices of , this algorithm requires sample complexity (1) ( ) and time complexity ( ) ( ) . Prior work required either an additional additive Ω( log ) term in the minimum separation or an explicit upper bound on the Euclidean norm of the centers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 48e36f39-00fc-4a22-af74-7ae65a67fa9fCited by top-tier papers13
- Polynomial Time and Private Learning of Unbounded Gaussian Mixture ModelsJamil Arbas, Hassan Ashtiani, Christopher LiawICML 2023 · 32 citations
- Private Distribution Learning with Public Data: The View from Sample CompressionShai Ben-David, Alex Bie, Clément L. Canonne, Gautam Kamath et al.NeurIPS 2023 · 18 citations
- Differentially Private Hierarchical Clustering with Provable Approximation GuaranteesJacob Imola, Alessandro Epasto, Mohammad Mahdian, Vincent Cohen-Addad et al.ICML 2023 · 10 citations
- Differentially private exact recovery for stochastic block modelsDung Nguyen, Anil Kumar S. VullikantiICML 2024 · 5 citations
- A Differentially Private Clustering Algorithm for Well-Clustered GraphsWeiqiang He, Hendrik Fichtenberger, Pan PengICLR 2024 · 3 citations
Builds on11
- FriendlyCore: Practical Differentially Private AggregationEliad Tsfadia, Edith Cohen, Haim Kaplan, Yishay Mansour et al.ICML 2022 · 39 citations
- Polynomial Time and Private Learning of Unbounded Gaussian Mixture ModelsJamil Arbas, Hassan Ashtiani, Christopher LiawICML 2023 · 32 citations
- Differentially Private Community Detection for Stochastic Block ModelsMohamed S. Mohamed, Dung Nguyen, Anil Vullikanti, Ravi TandonICML 2022 · 24 citations
- Robustly learning mixtures of k arbitrary GaussiansAinesh Bakshi, Ilias Diakonikolas, He Jia, Daniel M. Kane et al.STOC 2022 · 21 citations
- Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanismSamuel B. Hopkins, Gautam Kamath, Mahbod MajidSTOC 2022 · 20 citations
Related papers
- Privately Estimating a Gaussian: Efficient, Robust, and OptimalDaniel Alabi, Pravesh K. Kothari, Pranay Tankala, Prayaag Venkat et al.STOC 2023 · 8 citations
- Robustness Implies Privacy in Statistical EstimationSamuel B. Hopkins, Gautam Kamath, Mahbod Majid, Shyam NarayananSTOC 2023 · 16 citations
- Sample-Efficient Private Learning of Mixtures of GaussiansHassan Ashtiani, Mahbod Majid, Shyam NarayananNeurIPS 2024
- Private Estimation with Public DataAlex Bie, Gautam Kamath, Vikrant SinghalNeurIPS 2022 · 40 citations
- Clustering mixtures with almost optimal separation in polynomial timeAllen Liu, Jerry LiSTOC 2022 · 1 citation
