Differentially Private Linear Sketches: Efficient Implementations and Applications
Fuheng Zhao, Dan Qiao, Rachel Redberg, Divyakant Agrawal, Amr El Abbadi, Yu-Xiang Wang
Abstract
Linear sketches have been widely adopted to process fast data streams, and they can be used to accurately answer frequency estimation, approximate top K items, and summarize data distributions. When data are sensitive, it is desirable to provide privacy guarantees for linear sketches to preserve private information while delivering useful results with theoretical bounds. We show that linear sketches can ensure privacy and maintain their unique properties with a small amount of noise added at initialization. From the differentially private linear sketches, we showcase that the state-of-the-art quantile sketch in the turnstile model can also be private and maintain high performance. Experiments further demonstrate that our proposed differentially private sketches are quantitatively and qualitatively similar to noise-free sketches with high utilization on synthetic and real datasets. Differential privacy [Dwork et al., 2006] is a widely-accepted definition of privacy. Recently, researchers have observed that some data sketches are inherently differentially private [Blocki et al., 2012 , Smith et al., 2020] , while many other data sketches need modifications to the algorithm to be
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ef89b37b-19ec-4211-b104-7081911dea3fCited by top-tier papers17
- Improved Utility Analysis of Private CountSketchRasmus Pagh, Mikkel ThorupNeurIPS 2022 · 25 citations
- Panakos: Chasing the Tails for Multidimensional Data StreamsFuheng Zhao, Punnal Ismail Khan, Divyakant Agrawal, Amr El Abbadi et al.VLDB 2023 · 18 citations
- Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step SizesDan Qiao, Kaiqi Zhang, Esha Singh, Daniel Soudry et al.NeurIPS 2024 · 15 citations
- Smooth Flipping Probability for Differential Private Sign Random Projection MethodsPing Li, Xiaoyun LiNeurIPS 2023 · 7 citations
- On Differential Privacy and Adaptive Data Analysis with Bounded SpaceItai Dinur, Uri Stemmer, David P. Woodruff, Samson ZhouEUROCRYPT 2023 · 5 citations
Builds on12
- FetchSGD: Communication-Efficient Federated Learning with SketchingDaniel Rothchild, Ashwinee Panda, Enayat Ullah, Nikita Ivkin et al.ICML 2020 · 425 citations
- The Discrete Gaussian for Differential PrivacyClément L. Canonne, Gautam Kamath, Thomas SteinkeNeurIPS 2020 · 355 citations
- Practical and Private (Deep) Learning Without Sampling or ShufflingPeter Kairouz, Brendan McMahan, Shuang Song, Om Thakkar et al.ICML 2021 · 239 citations
- Efficient Private Statistics with Succinct SketchesLuca Melis, George Danezis, Emiliano De CristofaroNDSS 2016 · 128 citations
- The Flajolet-Martin Sketch Itself Preserves Differential Privacy: Private Counting with Minimal SpaceAdam D. Smith, Shuang Song, Abhradeep ThakurtaNeurIPS 2020 · 48 citations
Related papers
- Differentially Private Fractional Frequency Moments Estimation with Polylogarithmic SpaceLun Wang, Iosif Pinelis, Dawn SongICLR 2022 · 19 citations
- Fast Private Kernel Density Estimation via Locality Sensitive QuantizationTal Wagner, Yonatan Naamad, Nina MishraICML 2023 · 11 citations
- Order-Invariant Cardinality Estimators Are Differentially PrivateCharlie Dickens, Justin Thaler, Daniel TingNeurIPS 2022 · 17 citations
- DPSW-Sketch: A Differentially Private Sketch Framework for Frequency Estimation over Sliding WindowsYiping Wang, Yanhao Wang, Cen ChenKDD 2024 · 2 citations
- Differentially Private Space-Efficient Algorithms for Counting Distinct Elements in the Turnstile ModelRachel Cummings, Alessandro Epasto, Jieming Mao, Tamalika Mukherjee et al.ICML 2025
