Sliced Rényi Pufferfish Privacy: Tractable Privatization Mechanism and Private Learning with Gradient Clipping
Tao Zhang, Yevgeniy Vorobeychik
摘要
We study the design of a privatization mechanism and privacy accounting in the Pufferfish Privacy (PP) family. Specifically, motivated by the curse of dimensionality and lack of practical composition tools for iterative learning in the recent Rényi Pufferfish Privacy (RPP) framework, we propose Sliced Rényi Pufferfish Privacy (SRPP) . SRPP preserves PP/RPP semantics (customizable secrets with probability-aware secret–dataset relationships) while replacing high-dimensional Rényi divergence with projection-based quantification via two sliced measures, Average SRPP and Joint SRPP . We develop sliced Wasserstein mechanisms , yielding sound SRPP certificates and closed-form Gaussian noise calibration. For iterative learning systems, we introduce an SRPP-SGD scheme with gradient clipping and new accountants based on History-Uniform Caps (HUC) and a subsampling-aware variant (sa-HUC), enabling decompose-then-compose privatization and additive composition under a common slicing geometry. Experiments on static and iterative privatization show that the proposed framework exhibits favorable privacy–utility trade-offs, as well as practical scalability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- Faster Wasserstein Distance Estimation with the Sinkhorn DivergenceLénaïc Chizat, Pierre Roussillon, Flavien Léger, François-Xavier Vialard 等NeurIPS 2020 · 被引用 164 次
- Hyperparameter Tuning with Renyi Differential PrivacyNicolas Papernot, Thomas SteinkeICLR 2022 · 被引用 157 次
- Distributional Sliced-Wasserstein and Applications to Generative ModelingKhai Nguyen, Nhat Ho, Tung Pham, Hung BuiICLR 2021 · 被引用 111 次
- Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein DistancesSloan Nietert, Ziv Goldfeld, Ritwik Sadhu, Kengo KatoNeurIPS 2022 · 被引用 73 次
相关 Paper
- Rényi Pufferfish Privacy: General Additive Noise Mechanisms and Privacy Amplification by Iteration via Shift Reduction LemmasClément Pierquin, Aurélien Bellet, Marc Tommasi, Matthieu BoussardICML 2024 · 被引用 6 次
- Wasserstein Differential PrivacyChengyi Yang, Jiayin Qi, Aimin ZhouAAAI 2024 · 被引用 4 次
- Residual-PAC Privacy: Automatic Privacy Control Beyond the Gaussian BarrierTao Zhang, Yevgeniy VorobeychikUSENIX Security 2026 · 被引用 4 次
- Unified Mechanism-Specific Amplification by Subsampling and Group Privacy AmplificationJan Schuchardt, Mihail Stoian, Arthur Kosmala, Stephan GünnemannNeurIPS 2024 · 被引用 8 次
- Mitigating the Privacy-Utility Trade-off in Decentralized Federated Learning via f-Differential PrivacyXiang Li, Chendi Wang, Buxin Su, Qi Long 等NeurIPS 2025 · 被引用 4 次
