Mitigating the Privacy-Utility Trade-off in Decentralized Federated Learning via f-Differential Privacy
Xiang Li, Chendi Wang, Buxin Su, Qi Long, Weijie Su
摘要
Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging due to the co-existence of complex algorithmic components such as decentralized communication and local updates. This paper addresses privacy accounting for two decentralized FL algorithms within the -differential privacy (-DP) framework. We develop two new -DP-based accounting methods tailored to decentralized settings: Pairwise Network -DP (PN--DP), which quantifies privacy leakage between user pairs under random-walk communication, and Secret-based -Local DP (Sec--LDP), which supports structured noise injection via shared secrets. By combining tools from -DP theory and Markov chain concentration, our accounting framework captures privacy amplification arising from sparse communication, local iterations, and correlated noise. Experiments on synthetic and real datasets demonstrate that our methods yield consistently tighter bounds and improved utility compared to Rényi DP-based approaches, illustrating the benefits of -DP in decentralized privacy accounting.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper24
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan 等CCS 2016 · 被引用 7,620 次
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 被引用 5,137 次
- Practical Secure Aggregation for Privacy-Preserving Machine LearningKallista A. Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone 等CCS 2017 · 被引用 3,936 次
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang 等ICLR 2020 · 被引用 2,930 次
- Inverting Gradients - How easy is it to break privacy in federated learning?Jonas Geiping, Hartmut Bauermeister, Hannah Dröge, Michael MoellerNeurIPS 2020 · 被引用 1,822 次
相关 Paper
- Differentially Private Decentralized Learning with Random WalksEdwige Cyffers, Aurélien Bellet, Jalaj UpadhyayICML 2024 · 被引用 10 次
- The Privacy Power of Correlated Noise in Decentralized LearningYoussef Allouah, Anastasia Koloskova, Aymane El Firdoussi, Martin Jaggi 等ICML 2024 · 被引用 20 次
- Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and AveragingEdwige Cyffers, Mathieu Even, Aurélien Bellet, Laurent MassouliéNeurIPS 2022 · 被引用 39 次
- Privacy Amplification via Random Check-InsBorja Balle, Peter Kairouz, Brendan McMahan, Om Dipakbhai Thakkar 等NeurIPS 2020 · 被引用 86 次
- Differentially Private Federated Learning with Time-Adaptive Privacy SpendingShahrzad Kiani, Nupur Kulkarni, Adam Dziedzic, Stark C. Draper 等ICLR 2025
