An Iconic Heavy Hitters Algorithm Made Private
Rayne Holland
Abstract
Identifying heavy hitters in data streams is a fundamental problem with widespread applications in modern analytics systems. These streams are often derived from sensitive user activity, making update-level privacy guarantees necessary. While recent work has adapted the classical heavy hitter algorithm Misra-Gries to satisfy differential privacy in the streaming model, the privatization of other heavy hitter algorithms with better empirical utility is absent. Under this observation, we present the first differentially private variant of the SpaceSaving algorithm, which, in the non-private setting, is regarded as the state-of-the-art in practice. Our construction post-processes a non-private SpaceSaving summary by injecting asymptotically optimal noise and applying a carefully calibrated selection rule that suppresses unstable labels. This yields strong privacy guarantees while preserving the empirical advantages of SpaceSaving. Second, we introduce a generic method for extracting heavy hitters from any differentially private frequency oracle in the data stream model. The method requires only O(k) additional memory, where k is the number of heavy items, and provides a mechanism for safely releasing item identities from noisy frequency estimates. This yields an efficient, plug-and-play approach for private heavy hitter recovery from linear sketches. Finally, we conduct an experimental evaluation on synthetic and real-world datasets. Across a wide range of privacy parameters and space budgets, our method provides superior utility to the existing differentially private Misra-Gries algorithm. Our results demonstrate that the empirical superiority of SpaceSaving survives privatization and that efficient, practical heavy hitter identification is achievable under strong differential privacy guarantees.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 273d37e4-d442-4572-87e4-a3e5d98d629aBuilds on4
- Heavy Hitter Estimation over Set-Valued Data with Local Differential PrivacyZhan Qin, Yin Yang, Ting Yu, Issa Khalil et al.CCS 2016 · 344 citations
- Continuous Release of Data Streams under both Centralized and Local Differential PrivacyTianhao Wang, Joann Qiongna Chen, Zhikun Zhang, Dong Su et al.CCS 2021 · 66 citations
- Differentially Private Linear Sketches: Efficient Implementations and ApplicationsFuheng Zhao, Dan Qiao, Rachel Redberg, Divyakant Agrawal et al.NeurIPS 2022 · 40 citations
- Improved Utility Analysis of Private CountSketchRasmus Pagh, Mikkel ThorupNeurIPS 2022 · 25 citations
Related papers
- DPSW-Sketch: A Differentially Private Sketch Framework for Frequency Estimation over Sliding WindowsYiping Wang, Yanhao Wang, Cen ChenKDD 2024 · 2 citations
- Differentially Private -Heavy Hitters in the Sliding Window ModelJeremiah Blocki, Seunghoon Lee, Tamalika Mukherjee, Samson ZhouICLR 2023
- The SpaceSaving± Family of Algorithms for Data Streams with Bounded DeletionsFuheng Zhao, Divyakant Agrawal, Amr El Abbadi, Claire Mathieu et al.ICDE 2025
- Frequency Estimation under Local Differential PrivacyGraham Cormode, Samuel Maddock, Carsten MapleVLDB 2021 · 70 citations
- HeavyLocker: Lock Heavy Hitters in Distributed Data StreamsQilong Shi, Xirui Li, Hanyue Zheng, Tong Yang et al.KDD 2025 · 2 citations
