Differentially Private Continual Release with Relative Error
Bo Li, Wei Wang, Peng Ye
Abstract
This work investigates several fundamental tasks, including , , , and , in the continual release model under differential privacy. Previous research has demonstrated that any algorithm for these tasks must admit a large purely additive error. We show that the error can be substantially reduced if a relative error term is allowed, provided that the input stream is generated non-adaptively. However, when input data records can be selected adaptively, we prove that a large error is inevitable for the task of selecting an attribute with a small cumulative sum, whereas small error bounds remain achievable for other tasks. This reveals a significant separation between non-adaptive and adaptive streams. We also complement our algorithms with nearly matching lower bounds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive StreamsSergey Denisov, H. Brendan McMahan, John Rush, Adam D. Smith et al.NeurIPS 2022 · 96 citations
- The Price of Differential Privacy under Continual ObservationPalak Jain, Sofya Raskhodnikova, Satchit Sivakumar, Adam D. SmithICML 2023 · 63 citations
- Near-Optimal Algorithms for Private Online Optimization in the Realizable RegimeHilal Asi, Vitaly Feldman, Tomer Koren, Kunal TalwarICML 2023 · 12 citations
- The Limits of Differential Privacy in Online LearningBo Li, Wei Wang, Peng YeNeurIPS 2024 · 9 citations
- Skirting Additive Error Barriers for Private Turnstile StreamsAnders Aamand, Justin Y. Chen, Sandeep SilwalICLR 2026 · 2 citations
Related papers
- Continual Counting with Gradual Privacy ExpirationJoel Daniel Andersson, Monika Henzinger, Rasmus Pagh, Teresa Anna Steiner et al.NeurIPS 2024 · 4 citations
- Differentially Private Space-Efficient Algorithms for Counting Distinct Elements in the Turnstile ModelRachel Cummings, Alessandro Epasto, Jieming Mao, Tamalika Mukherjee et al.ICML 2025
- Counting Distinct Elements in the Turnstile Model with Differential Privacy under Continual ObservationPalak Jain, Iden Kalemaj, Sofya Raskhodnikova, Satchit Sivakumar et al.NeurIPS 2023 · 24 citations
- Continual Observation under User-level Differential PrivacyWei Dong, Qiyao Luo, Ke YiS&P 2023
- Constant Matters: Fine-grained Error Bound on Differentially Private Continual ObservationHendrik Fichtenberger, Monika Henzinger, Jalaj UpadhyayICML 2023 · 34 citations
