Does Egalitarian Fairness Lead to Instability? The Fairness Bounds in Stable Federated Learning Under Altruistic Behaviors
Jiashi Gao, Ziwei Wang, Xiangyu Zhao, Xin Yao, Xuetao Wei
Abstract
Federated learning (FL) offers a machine learning paradigm that protects privacy, allowing multiple clients to collaboratively train a global model while only accessing their local data. Recent research in FL has increasingly focused on improving the uniformity of model performance across clients, a fairness principle known as egalitarian fairness. However, achieving egalitarian fairness in FL may sacrifice the model performance for data-rich clients to benefit those with less data. This trade-off raises concerns about the stability of FL, as data-rich clients may opt to leave the current coalition and join another that is more closely aligned with its expected high performance. In this context, our work rigorously addresses the critical concern: Does egalitarian fairness lead to instability? Drawing from game theory and social choice theory, we initially characterize fair FL systems as altruism coalition formation games (ACFGs) and reveal that the instability issues emerging from the pursuit of egalitarian fairness are significantly related to the clients’ altruism within the coalition and the configuration of the friends-relationship networks among the clients. Then, we theoretically propose the optimal egalitarian fairness bounds that an FL coalition can achieve while maintaining core stability under various types of altruistic behaviors. The theoretical contributions clarify the quantitative relationships between achievable egalitarian fairness and the disparities in the sizes of local datasets, disproving the misconception that egalitarian fairness inevitably leads to instability. Finally, we conduct experiments to evaluate the consistency of our theoretically derived egalitarian fairness bounds with the empirically achieved egalitarian fairness in fair FL settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7c1bb527-19c8-4a32-a8ff-83020e4c91c1Builds on11
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
- Fair Resource Allocation in Federated LearningTian Li, Maziar Sanjabi, Ahmad Beirami, Virginia SmithICLR 2020 · 971 citations
- Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine LearningXinyi Xu, Lingjuan Lyu, Xingjun Ma, Chenglin Miao et al.NeurIPS 2021 · 133 citations
- Addressing Algorithmic Disparity and Performance Inconsistency in Federated LearningSen Cui, Weishen Pan, Jian Liang, Changshui Zhang et al.NeurIPS 2021 · 112 citations
- Model-sharing Games: Analyzing Federated Learning Under Voluntary ParticipationKate Donahue, Jon M. KleinbergAAAI 2021 · 96 citations
Related papers
- Fairness in Federated Learning via Core-StabilityBhaskar Ray Chaudhury, Linyi Li, Mintong Kang, Bo Li et al.NeurIPS 2022 · 49 citations
- Optimality and Stability in Federated Learning: A Game-theoretic ApproachKate Donahue, Jon M. KleinbergNeurIPS 2021 · 74 citations
- Fairness in model-sharing gamesKate Donahue, Jon M. KleinbergWWW 2023 · 12 citations
- Collaboration Equilibrium in Federated LearningSen Cui, Jian Liang, Weishen Pan, Kun Chen et al.KDD 2022 · 17 citations
- FairTrade: Achieving Pareto-Optimal Trade-Offs between Balanced Accuracy and Fairness in Federated LearningMaryam Badar, Sandipan Sikdar, Wolfgang Nejdl, Marco FisichellaAAAI 2024 · 21 citations
