Efficient and Accurate Differentially Private Cardinality Continual Releases
Dongdong Xie, Pinghui Wang, Quanqing Xu, Chuanhui Yang, Rundong Li
Abstract
Accurately estimating the number of unique elements that appear in data streams in real time is a fundamental problem with applications including network traffic monitoring and real-time social media analytics. Traditional sketch-based algorithms such as FM Sketch and HyperLogLog offer memory-friendly solutions for cardinality estimation but fall short in scenarios where the stream elements are privacy-sensitive and require differential privacy. Although recent approaches have incorporated differential privacy into the above cardinality estimators, they are limited to single-query settings, restricting their applicability. Previous methods for private cardinality continual release settings-i.e., releasing the cardinality after each new element in the stream-demand large memory resources and are thus difficult to apply in practice. In this paper, we present a novel cardinality estimation framework, FC, which ensures differential privacy under continual releases while simultaneously achieving low memory usage, high accuracy, and efficient computation. Our approach innovatively leverages an efficient cardinality estimator and privacy-preserving mechanisms to overcome the limitations of existing methods. Comprehensive experiments demonstrate that our method reduces memory usage by up to 504 times compared to the best previous method while maintaining nearly the same accuracy. Additionally, under identical memory constraints, our method improves the estimation accuracy by orders of magnitude.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ba959044-ae36-45b0-92c9-4f9cf964f0d0Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive StreamsSergey Denisov, H. Brendan McMahan, John Rush, Adam D. Smith et al.NeurIPS 2022 · 96 citations
- Continuous Release of Data Streams under both Centralized and Local Differential PrivacyTianhao Wang, Joann Qiongna Chen, Zhikun Zhang, Dong Su et al.CCS 2021 · 66 citations
- The Flajolet-Martin Sketch Itself Preserves Differential Privacy: Private Counting with Minimal SpaceAdam D. Smith, Shuang Song, Abhradeep ThakurtaNeurIPS 2020 · 48 citations
- Private Continual Release of Real-Valued Data StreamsVictor Perrier, Hassan Jameel Asghar, Dali KaafarNDSS 2019 · 46 citations
- Constant Matters: Fine-grained Error Bound on Differentially Private Continual ObservationHendrik Fichtenberger, Monika Henzinger, Jalaj UpadhyayICML 2023 · 34 citations
Related papers
- An Effective and Differentially Private Protocol for Secure Distributed Cardinality EstimationPinghui Wang, Chengjin Yang, Dongdong Xie, Junzhou Zhao et al.SIGMOD 2023 · 5 citations
- Order-Invariant Cardinality Estimators Are Differentially PrivateCharlie Dickens, Justin Thaler, Daniel TingNeurIPS 2022 · 17 citations
- An LDP Compatible Sketch for Securely Approximating Set Intersection CardinalitiesPinghui Wang, Yitong Liu, Zhicheng Li, Rundong LiSIGMOD 2024 · 7 citations
- ZRing: A Dynamic Sketch for Weighted Cardinality Estimation in Data StreamsZhicheng Li, Pinghui Wang, Qiheng Song, Rundong Li et al.KDD 2026
- A Better Cardinality Estimator with Fewer Bits, Constant Update Time, and MergeabilityYang Du, He Huang, Yu-e Sun, Kejian Li et al.INFOCOM 2023 · 6 citations
