Tight and Robust Private Mean Estimation with Few Users
Shyam Narayanan, Vahab S. Mirrokni, Hossein Esfandiari
摘要
In this work, we study high-dimensional mean estimation under user-level differential privacy, and design an (ε, δ)-differentially private mechanism using as few users as possible. In particular, we provide a nearly optimal trade-off between the number of users and the number of samples per user required for private mean estimation, even when the number of users is as low as O( 1 ε log 1 δ ). Interestingly, this bound on the number of users is independent of the dimension (though the number of samples per user is allowed to depend polynomially on the dimension), unlike the previous work that requires the number of users to depend polynomially on the dimension. This resolves a problem first proposed by Amin et al. [3] . Moreover, our mechanism is robust against corruptions in up to 49% of the users. Finally, our results also apply to optimal algorithms for privately learning discrete distributions with few users, answering a question of Liu et al. [24], and a broader range of problems such as stochastic convex optimization and a variant of stochastic gradient descent via a reduction to differentially private mean estimation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper15
- DP-PCA: Statistically Optimal and Differentially Private PCAXiyang Liu, Weihao Kong, Prateek Jain, Sewoong OhNeurIPS 2022 · 被引用 38 次
- User-Level Differential Privacy With Few Examples Per UserBadih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi 等NeurIPS 2023 · 被引用 19 次
- Robustness Implies Privacy in Statistical EstimationSamuel B. Hopkins, Gautam Kamath, Mahbod Majid, Shyam NarayananSTOC 2023 · 被引用 16 次
- Subspace Recovery from Heterogeneous Data with Non-isotropic NoiseJohn C. Duchi, Vitaly Feldman, Lunjia Hu, Kunal TalwarNeurIPS 2022 · 被引用 16 次
- Algorithms for bounding contribution for histogram estimation under user-level privacyYuhan Liu, Ananda Theertha Suresh, Wennan Zhu, Peter Kairouz 等ICML 2023 · 被引用 14 次
它引用的顶会 Paper10
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale 等NeurIPS 2021 · 被引用 113 次
- Robust and differentially private mean estimationXiyang Liu, Weihao Kong, Sham M. Kakade, Sewoong OhNeurIPS 2021 · 被引用 87 次
- Instance-optimal Mean Estimation Under Differential PrivacyZiyue Huang, Yuting Liang, Ke YiNeurIPS 2021 · 被引用 74 次
- Differentially Private Clustering: Tight Approximation RatiosBadih Ghazi, Ravi Kumar, Pasin ManurangsiNeurIPS 2020 · 被引用 68 次
相关 Paper
- On User-Level Private Convex OptimizationBadih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi 等ICML 2023 · 被引用 10 次
- User-level Private Stochastic Convex Optimization with Optimal RatesRaef Bassily, Ziteng SunICML 2023 · 被引用 17 次
- A Central Limit Theorem for Differentially Private Query AnsweringJinshuo Dong, Weijie J. Su, Linjun ZhangNeurIPS 2021 · 被引用 21 次
- Better Locally Private Sparse Estimation Given Multiple Samples Per UserYuheng Ma, Ke Jia, Hanfang YangICML 2024 · 被引用 2 次
- Learning discrete distributions: user vs item-level privacyYuhan Liu, Ananda Theertha Suresh, Felix X. Yu, Sanjiv Kumar 等NeurIPS 2020 · 被引用 63 次
