Privacy amplification by random allocation
Moshe Shenfeld, Vitaly Feldman
摘要
We consider the privacy amplification properties of a sampling scheme in which a user's data is used in k steps chosen randomly and uniformly from a sequence (or set) of t steps. This sampling scheme has been recently applied in the context of differentially private optimization [Chua et al., 2024a, Choquette-Choo et al., 2025] and is also motivated by communication-efficient high-dimensional private aggregation [Asi et al., 2025]. Existing analyses of this scheme either rely on privacy amplification by shuffling which leads to overly conservative bounds or require Monte Carlo simulations that are computationally prohibitive in most practical scenarios. We give the first theoretical guarantees and numerical estimation algorithms for this sampling scheme. In particular, we demonstrate that the privacy guarantees of random k-out-of-t allocation can be upper bounded by the privacy guarantees of the well-studied independent (or Poisson) subsampling in which each step uses the user's data with probability . Further, we provide two additional analysis techniques that lead to numerical improvements in several parameter regimes. Altogether, our bounds give efficiently-computable and nearly tight numerical results for random allocation applied to Gaussian noise addition.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper6
- To Shuffle or not to Shuffle: Auditing DP-SGD with ShufflingMeenatchi Sundaram Muthu Selva Annamalai, Borja Balle, Jamie Hayes, Emiliano De CristofaroNDSS 2026 · 被引用 11 次
- Efficient privacy loss accounting for subsampling and random allocationVitaly Feldman, Moshe ShenfeldICML 2026 · 被引用 5 次
- Fundamental Limitations of Favorable Privacy–Utility Guarantees for DP-SGDMurat Bilgehan Ertan), Marten van Dijk)CCS 2026 · 被引用 3 次
- Convex Approximation of Two-Layer ReLU Networks for Hidden State Differential PrivacyRob Romijnders, Antti KoskelaNeurIPS 2025 · 被引用 2 次
- PREAMBLE: Private and Efficient Aggregation via Block Sparse VectorsHilal Asi, Vitaly Feldman, Hannah Keller, Guy N. Rothblum 等NeurIPS 2025 · 被引用 1 次
它引用的顶会 Paper10
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- The Discrete Gaussian for Differential PrivacyClément L. Canonne, Gautam Kamath, Thomas SteinkeNeurIPS 2020 · 被引用 355 次
- Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by ShufflingVitaly Feldman, Audra McMillan, Kunal TalwarFOCS 2021 · 被引用 76 次
- Privacy Amplification via Compression: Achieving the Optimal Privacy-Accuracy-Communication Trade-off in Distributed Mean EstimationWei-Ning Chen, Dan Song, Ayfer Özgür, Peter KairouzNeurIPS 2023 · 被引用 42 次
- Scalable DP-SGD: Shuffling vs. Poisson SubsamplingLynn Chua, Badih Ghazi, Pritish Kamath, Ravi Kumar 等NeurIPS 2024 · 被引用 29 次
相关 Paper
- Privacy Amplification by Sampling under User-level Differential PrivacyJuanru Fang, Ke YiSIGMOD 2024 · 被引用 4 次
- Privacy Amplification via Random Check-InsBorja Balle, Peter Kairouz, Brendan McMahan, Om Dipakbhai Thakkar 等NeurIPS 2020 · 被引用 86 次
- Almost Instance-optimal Clipping for Summation Problems in the Shuffle Model of Differential PrivacyWei Dong, Qiyao Luo, Giulia Fanti, Elaine Shi 等CCS 2024
- Faster Privacy Accounting via Evolving DiscretizationBadih Ghazi, Pritish Kamath, Ravi Kumar, Pasin ManurangsiICML 2022 · 被引用 20 次
- Differentially Private Aggregation in the Shuffle Model: Almost Central Accuracy in Almost a Single MessageBadih Ghazi, Ravi Kumar, Pasin Manurangsi, Rasmus Pagh 等ICML 2021 · 被引用 45 次
