Mitigating the Privacy-Utility Trade-off in Decentralized Federated Learning via f-Differential Privacy
Xiang Li, Chendi Wang, Buxin Su, Qi Long, Weijie Su
Abstract
Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging due to the co-existence of complex algorithmic components such as decentralized communication and local updates. This paper addresses privacy accounting for two decentralized FL algorithms within the -differential privacy (-DP) framework. We develop two new -DP-based accounting methods tailored to decentralized settings: Pairwise Network -DP (PN--DP), which quantifies privacy leakage between user pairs under random-walk communication, and Secret-based -Local DP (Sec--LDP), which supports structured noise injection via shared secrets. By combining tools from -DP theory and Markov chain concentration, our accounting framework captures privacy amplification arising from sparse communication, local iterations, and correlated noise. Experiments on synthetic and real datasets demonstrate that our methods yield consistently tighter bounds and improved utility compared to Rényi DP-based approaches, illustrating the benefits of -DP in decentralized privacy accounting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bb7fdd3c-ab50-41bb-9eab-527b9a01f953Cited by top-tier papers1
Ask how each one uses itBuilds on24
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan et al.CCS 2016 · 7,620 citations
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 5,137 citations
- Practical Secure Aggregation for Privacy-Preserving Machine LearningKallista A. Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone et al.CCS 2017 · 3,936 citations
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Inverting Gradients - How easy is it to break privacy in federated learning?Jonas Geiping, Hartmut Bauermeister, Hannah Dröge, Michael MoellerNeurIPS 2020 · 1,822 citations
Related papers
- Differentially Private Decentralized Learning with Random WalksEdwige Cyffers, Aurélien Bellet, Jalaj UpadhyayICML 2024 · 10 citations
- The Privacy Power of Correlated Noise in Decentralized LearningYoussef Allouah, Anastasia Koloskova, Aymane El Firdoussi, Martin Jaggi et al.ICML 2024 · 20 citations
- Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and AveragingEdwige Cyffers, Mathieu Even, Aurélien Bellet, Laurent MassouliéNeurIPS 2022 · 39 citations
- Privacy Amplification via Random Check-InsBorja Balle, Peter Kairouz, Brendan McMahan, Om Dipakbhai Thakkar et al.NeurIPS 2020 · 86 citations
- Differentially Private Federated Learning with Time-Adaptive Privacy SpendingShahrzad Kiani, Nupur Kulkarni, Adam Dziedzic, Stark C. Draper et al.ICLR 2025
