Keeping a Secret Requires a Good Memory: Space Lower-Bounds for Private Algorithms
Alessandro Epasto, Xin Lyu, Pasin Manurangsi
摘要
We study the computational cost of differential privacy in terms of memory efficiency. While the trade-off between accuracy and differential privacy is well-understood, the inherent cost of privacy regarding memory use remains largely unexplored. This paper establishes for the first time an unconditional space lower bound for user-level differential privacy by introducing a novel proof technique based on a multi-player communication game. Central to our approach, this game formally links the hardness of low-memory private algorithms to the necessity of "contribution capping"-tracking and limiting the users who disproportionately impact the dataset. We demonstrate that winning this communication game requires transmitting information proportional to the number of overactive users, which translates directly to memory lower bounds. We apply this framework, as an example, to the fundamental problem of estimating the number of distinct elements in a stream and we prove that any private algorithm requires almost Ω(T 1/3 ) space to achieve certain error rates in a promise variant of the problem. This resolves an open problem in the literature (by Jain et al. (Jain et al., 2023a) and Cummings et al. (Cummings et al., 2025) ) and establishes the first exponential separation between the space complexity of private algorithms and their non-private O(1) counterparts for a natural statistical estimation task. Furthermore, we show that this communication-theoretic technique generalizes to broad classes of problems, yielding lower bounds for private medians, quantiles, and max-select.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper9
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- The Price of Differential Privacy under Continual ObservationPalak Jain, Sofya Raskhodnikova, Satchit Sivakumar, Adam D. SmithICML 2023 · 被引用 63 次
- Counting Distinct Elements in the Turnstile Model with Differential Privacy under Continual ObservationPalak Jain, Iden Kalemaj, Sofya Raskhodnikova, Satchit Sivakumar 等NeurIPS 2023 · 被引用 24 次
- Time-Aware Projections: Truly Node-Private Graph Statistics under Continual ObservationPalak Jain, Adam Smith, Connor WagamanS&P 2024 · 被引用 11 次
- On Differential Privacy and Adaptive Data Analysis with Bounded SpaceItai Dinur, Uri Stemmer, David P. Woodruff, Samson ZhouEUROCRYPT 2023 · 被引用 5 次
相关 Paper
- Counting Distinct Elements Under Person-Level Differential PrivacyThomas Steinke, Alexander KnopNeurIPS 2023 · 被引用 4 次
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale 等NeurIPS 2021 · 被引用 113 次
- Differentially Private Space-Efficient Algorithms for Counting Distinct Elements in the Turnstile ModelRachel Cummings, Alessandro Epasto, Jieming Mao, Tamalika Mukherjee 等ICML 2025
- Smoothly Bounding User Contributions in Differential PrivacyAlessandro Epasto, Mohammad Mahdian, Jieming Mao, Vahab S. Mirrokni 等NeurIPS 2020 · 被引用 17 次
- Frequency Estimation Under Multiparty Differential Privacy: One-shot and StreamingZiyue Huang, Yuan Qiu, Ke Yi, Graham CormodeVLDB 2022 · 被引用 28 次
