An Iconic Heavy Hitters Algorithm Made Private
Rayne Holland
摘要
Identifying heavy hitters in data streams is a fundamental problem with widespread applications in modern analytics systems. These streams are often derived from sensitive user activity, making update-level privacy guarantees necessary. While recent work has adapted the classical heavy hitter algorithm Misra-Gries to satisfy differential privacy in the streaming model, the privatization of other heavy hitter algorithms with better empirical utility is absent. Under this observation, we present the first differentially private variant of the SpaceSaving algorithm, which, in the non-private setting, is regarded as the state-of-the-art in practice. Our construction post-processes a non-private SpaceSaving summary by injecting asymptotically optimal noise and applying a carefully calibrated selection rule that suppresses unstable labels. This yields strong privacy guarantees while preserving the empirical advantages of SpaceSaving. Second, we introduce a generic method for extracting heavy hitters from any differentially private frequency oracle in the data stream model. The method requires only O(k) additional memory, where k is the number of heavy items, and provides a mechanism for safely releasing item identities from noisy frequency estimates. This yields an efficient, plug-and-play approach for private heavy hitter recovery from linear sketches. Finally, we conduct an experimental evaluation on synthetic and real-world datasets. Across a wide range of privacy parameters and space budgets, our method provides superior utility to the existing differentially private Misra-Gries algorithm. Our results demonstrate that the empirical superiority of SpaceSaving survives privatization and that efficient, practical heavy hitter identification is achievable under strong differential privacy guarantees.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Heavy Hitter Estimation over Set-Valued Data with Local Differential PrivacyZhan Qin, Yin Yang, Ting Yu, Issa Khalil 等CCS 2016 · 被引用 344 次
- Continuous Release of Data Streams under both Centralized and Local Differential PrivacyTianhao Wang, Joann Qiongna Chen, Zhikun Zhang, Dong Su 等CCS 2021 · 被引用 66 次
- Differentially Private Linear Sketches: Efficient Implementations and ApplicationsFuheng Zhao, Dan Qiao, Rachel Redberg, Divyakant Agrawal 等NeurIPS 2022 · 被引用 40 次
- Improved Utility Analysis of Private CountSketchRasmus Pagh, Mikkel ThorupNeurIPS 2022 · 被引用 25 次
相关 Paper
- DPSW-Sketch: A Differentially Private Sketch Framework for Frequency Estimation over Sliding WindowsYiping Wang, Yanhao Wang, Cen ChenKDD 2024 · 被引用 2 次
- Differentially Private -Heavy Hitters in the Sliding Window ModelJeremiah Blocki, Seunghoon Lee, Tamalika Mukherjee, Samson ZhouICLR 2023
- The SpaceSaving± Family of Algorithms for Data Streams with Bounded DeletionsFuheng Zhao, Divyakant Agrawal, Amr El Abbadi, Claire Mathieu 等ICDE 2025
- Frequency Estimation under Local Differential PrivacyGraham Cormode, Samuel Maddock, Carsten MapleVLDB 2021 · 被引用 70 次
- HeavyLocker: Lock Heavy Hitters in Distributed Data StreamsQilong Shi, Xirui Li, Hanyue Zheng, Tong Yang 等KDD 2025 · 被引用 2 次
