Samplable Anonymous Aggregation for Private Federated Data Analysis
Kunal Talwar, Shan Wang, Audra McMillan, Vitaly Feldman, Pansy Bansal, Bailey Basile, Áine Cahill, Yi Sheng Chan, Mike Chatzidakis, Junye Chen, Oliver R. A. Chick, Mona Chitnis
摘要
We revisit the problem of designing scalable protocols for private statistics and private federated learning when each device holds its private data. Locally differentially private algorithms require little trust but are (provably) limited in their utility. Centrally differentially private algorithms can allow significantly better utility but require a trusted curator. This gap has led to significant interest in the design and implementation of simple cryptographic primitives, that can allow central-like utility guarantees without having to trust a central server. Our first contribution is to propose a new primitive that allows for efficient implementation of several commonly used algorithms, and allows for privacy accounting that is close to that in the central setting without requiring the strong trust assumptions it entails. Shuffling and aggregation primitives that have been proposed in earlier works enable this for some algorithms, but have significant limitations as primitives. We propose a Samplable Anonymous Aggregation primitive, which computes an aggregate over a random subset of the inputs and show that it leads to better privacy-utility trade-offs for various fundamental tasks. Secondly, we propose a system architecture that implements this primitive and perform a security analysis of the proposed system. Our design combines additive secret-sharing with anonymization and authentication infrastructures.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- PINE: Efficient Verification of a Euclidean Norm Bound of a Secret-Shared VectorGuy N. Rothblum, Eran Omri, Junye Chen, Kunal TalwarUSENIX Security 2024 · 被引用 7 次
- POPSTAR: Lightweight Threshold Reporting with Reduced LeakageHanjun Li, Sela Navot, Stefano TessaroUSENIX Security 2024 · 被引用 5 次
- PAPAYA Federated Analytics Stack: Engineering Privacy, Scalability and PracticalityHarish Srinivas, Graham Cormode, Mehrdad Honarkhah, Samuel Lurye 等NSDI 2025 · 被引用 2 次
- PREAMBLE: Private and Efficient Aggregation via Block Sparse VectorsHilal Asi, Vitaly Feldman, Hannah Keller, Guy N. Rothblum 等NeurIPS 2025 · 被引用 1 次
- Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers, and Gradient ClippingMartin Pelikan, Sheikh Shams Azam, Vitaly Feldman, Jan Honza Silovsky 等NeurIPS 2025 · 被引用 1 次
它引用的顶会 Paper41
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 被引用 5,137 次
- Practical Secure Aggregation for Privacy-Preserving Machine LearningKallista A. Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone 等CCS 2017 · 被引用 3,936 次
- Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski 等USENIX Security 2021 · 被引用 2,866 次
- Inverting Gradients - How easy is it to break privacy in federated learning?Jonas Geiping, Hartmut Bauermeister, Hannah Dröge, Michael MoellerNeurIPS 2020 · 被引用 1,822 次
相关 Paper
- Private Counting from Anonymous Messages: Near-Optimal Accuracy with Vanishing Communication OverheadBadih Ghazi, Ravi Kumar, Pasin Manurangsi, Rasmus PaghICML 2020 · 被引用 59 次
- Secure Single-Server Aggregation with (Poly)Logarithmic OverheadJames Henry Bell, Kallista A. Bonawitz, Adrià Gascón, Tancrède Lepoint 等CCS 2020 · 被引用 13 次
- Shuffle Private Stochastic Convex OptimizationAlbert Cheu, Matthew Joseph, Jieming Mao, Binghui PengICLR 2022 · 被引用 29 次
- TACITA: Threshold Aggregation without Client InteractionVarun Madathil, Arthur Lazzaretti, Zeyu Liu, Charalampos PapamanthouCCS 2026 · 被引用 2 次
- Differentially Private Aggregation in the Shuffle Model: Almost Central Accuracy in Almost a Single MessageBadih Ghazi, Ravi Kumar, Pasin Manurangsi, Rasmus Pagh 等ICML 2021 · 被引用 45 次
