Continual Learning With Participation Privacy: An Auditable Buffering-Aggregation Recipe
Hubert Chan, Elaine Shi, Mengshi Zhao, Mingxun Zhou
Abstract
Modern federated and streaming learning systems often release intermediate models, so privacy must hold for the full trajectory under adaptive interaction. Motivated by participation privacy, we study single-edit neighboring user streams, where one insertion/deletion shifts all subsequent updates and defeats standard Hamming-neighbor continual-release analyses. We give an auditable modular recipe. A randomized buffering wrapper emits bins of size , reducing single-edit streams to a Hamming-style per-bin update stream with explicit backlog/delay guarantees, where is calibrated by the privacy parameters . We then prove a certification theorem for independently decomposable (prefix-causal, fresh-noise) continual mechanisms: any non-adaptive Hamming-neighbor DP proof lifts to adaptive inputs. Together, these ingredients yield trajectory-level -DP for single-edit streams using standard primitives (e.g., tree prefix sums), with an explicit privacy--latency link via . Streaming DP-SGD experiments validate the privacy-utility-latency tradeoffs and the induced delay distributions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Practical and Private (Deep) Learning Without Sampling or ShufflingPeter Kairouz, Brendan McMahan, Shuang Song, Om Thakkar et al.ICML 2021 · 239 citations
- Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive StreamsSergey Denisov, H. Brendan McMahan, John Rush, Adam D. Smith et al.NeurIPS 2022 · 96 citations
- The Price of Differential Privacy under Continual ObservationPalak Jain, Sofya Raskhodnikova, Satchit Sivakumar, Adam D. SmithICML 2023 · 63 citations
- Constant Matters: Fine-grained Error Bound on Differentially Private Continual ObservationHendrik Fichtenberger, Monika Henzinger, Jalaj UpadhyayICML 2023 · 34 citations
- Concurrent Composition Theorems for Differential PrivacySalil P. Vadhan, Wanrong ZhangSTOC 2023 · 11 citations
Related papers
- Trajectory-Aware Certified Decentralized Unlearning via SGD StabilityHengliang Wu, Jiale Yang, Shuzhen Chen, Di Wang et al.ICML 2026
- DPI: Ensuring Strict Differential Privacy for Infinite Data StreamingShuya Feng, Meisam Mohammady, Han Wang, Xiaochen Li et al.S&P 2024 · 17 citations
- Federated Linear Contextual Bandits with User-level Differential PrivacyRuiquan Huang, Huanyu Zhang, Luca Melis, Milan Shen et al.ICML 2023 · 17 citations
- Differentially Private Federated Learning with Local Regularization and SparsificationAnda Cheng, Peisong Wang, Xi Sheryl Zhang, Jian ChengCVPR 2022 · 104 citations
- Privacy Amplification via Random Check-InsBorja Balle, Peter Kairouz, Brendan McMahan, Om Dipakbhai Thakkar et al.NeurIPS 2020 · 86 citations
