USENIX Security2023Top-tier venue
FedVal: Different good or different bad in federated learning
Viktor Valadi, Xinchi Qiu, Pedro Porto Buarque de Gusmão, Nicholas D. Lane, Mina Alibeigi
Abstract
Federated learning (FL) systems are susceptible to attacks from malicious actors who might attempt to corrupt the training model through various poisoning attacks. FL also poses new challenges in addressing group bias, such as ensuring fair performance for different demographic groups. Traditional methods used to address such biases require centralized access to the data, which FL systems do not have. In this paper, we present a novel approach FedVal for both robustness and fairness that does not require any additional information from clients that could raise privacy concerns and consequently compromise the integrity of the FL system. To this end, we propose an innovative score function based on a server-side validation method that assesses client updates and determines the optimal aggregation balance between locallytrained models. Our research shows that this approach not only provides solid protection against poisoning attacks but can also be used to reduce group bias and subsequently promote fairness while maintaining the system's capability for differential privacy. Extensive experiments on the CIFAR-10, FEMNIST, and PUMS ACSIncome datasets in different configurations demonstrate the effectiveness of our method, resulting in state-of-the-art performances. We have proven robustness in situations where 80% of participating clients are malicious. Additionally, we have shown a significant increase in accuracy for underrepresented labels from 32% to 53%, and increase in recall rate for underrepresented features from 19% to 50%.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated LearningJialuo He, Wei Chen, Xiaojin ZhangAAAI 2025 · 12 citations
- Defending Against Sophisticated Poisoning Attacks with RL-based Aggregation in Federated LearningYujing Wang, Hainan Zhang, Sijia Wen, Wangjie Qiu et al.AAAI 2025 · 4 citations
- Fortifying Federated Learning Towards Trustworthiness via Auditable Data Valuation and Verifiable Client ContributionK. Naveen Kumar, Ranjeet Ranjan Jha, C. Krishna Mohan, Ravindra Babu TallamrajuCVPR 2025
Builds on11
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Federated Learning on Non-IID Data Silos: An Experimental StudyQinbin Li, Yiqun Diao, Quan Chen, Bingsheng HeICDE 2022 · 1,110 citations
- Retiring Adult: New Datasets for Fair Machine LearningFrances Ding, Moritz Hardt, John Miller, Ludwig SchmidtNeurIPS 2021 · 671 citations
- Differentially Private Learning with Adaptive ClippingGalen Andrew, Om Thakkar, Brendan McMahan, Swaroop RamaswamyNeurIPS 2021 · 425 citations
- FairFed: Enabling Group Fairness in Federated LearningYahya H. Ezzeldin, Shen Yan, Chaoyang He, Emilio Ferrara et al.AAAI 2023 · 310 citations
Related papers
- FedInv: Byzantine-Robust Federated Learning by Inversing Local Model UpdatesBo Zhao, Peng Sun, Tao Wang, Keyu JiangAAAI 2022 · 82 citations
- Fair Federated Learning Under Domain Skew with Local Consistency and Domain DiversityYuhang Chen, Wenke Huang, Mang YeCVPR 2024
- Byzantine-Robust Decentralized Federated LearningMinghong Fang, Zifan Zhang, Hairi, Prashant Khanduri et al.CCS 2024 · 38 citations
- Bias Mitigation in Federated Learning for Edge ComputingYasmine Djebrouni, Nawel Benarba, Ousmane Touat, Pasquale De Rosa et al.UbiComp 2024 · 23 citations
- FedDefender: Client-Side Attack-Tolerant Federated LearningSungwon Park, Sungwon Han, Fangzhao Wu, Sundong Kim et al.KDD 2023 · 26 citations
