Does Egalitarian Fairness Lead to Instability? The Fairness Bounds in Stable Federated Learning Under Altruistic Behaviors
Jiashi Gao, Ziwei Wang, Xiangyu Zhao, Xin Yao, Xuetao Wei
摘要
Federated learning (FL) offers a machine learning paradigm that protects privacy, allowing multiple clients to collaboratively train a global model while only accessing their local data. Recent research in FL has increasingly focused on improving the uniformity of model performance across clients, a fairness principle known as egalitarian fairness. However, achieving egalitarian fairness in FL may sacrifice the model performance for data-rich clients to benefit those with less data. This trade-off raises concerns about the stability of FL, as data-rich clients may opt to leave the current coalition and join another that is more closely aligned with its expected high performance. In this context, our work rigorously addresses the critical concern: Does egalitarian fairness lead to instability? Drawing from game theory and social choice theory, we initially characterize fair FL systems as altruism coalition formation games (ACFGs) and reveal that the instability issues emerging from the pursuit of egalitarian fairness are significantly related to the clients’ altruism within the coalition and the configuration of the friends-relationship networks among the clients. Then, we theoretically propose the optimal egalitarian fairness bounds that an FL coalition can achieve while maintaining core stability under various types of altruistic behaviors. The theoretical contributions clarify the quantitative relationships between achievable egalitarian fairness and the disparities in the sizes of local datasets, disproving the misconception that egalitarian fairness inevitably leads to instability. Finally, we conduct experiments to evaluate the consistency of our theoretically derived egalitarian fairness bounds with the empirically achieved egalitarian fairness in fair FL settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 被引用 1,313 次
- Fair Resource Allocation in Federated LearningTian Li, Maziar Sanjabi, Ahmad Beirami, Virginia SmithICLR 2020 · 被引用 971 次
- Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine LearningXinyi Xu, Lingjuan Lyu, Xingjun Ma, Chenglin Miao 等NeurIPS 2021 · 被引用 133 次
- Addressing Algorithmic Disparity and Performance Inconsistency in Federated LearningSen Cui, Weishen Pan, Jian Liang, Changshui Zhang 等NeurIPS 2021 · 被引用 112 次
- Model-sharing Games: Analyzing Federated Learning Under Voluntary ParticipationKate Donahue, Jon M. KleinbergAAAI 2021 · 被引用 96 次
相关 Paper
- Fairness in Federated Learning via Core-StabilityBhaskar Ray Chaudhury, Linyi Li, Mintong Kang, Bo Li 等NeurIPS 2022 · 被引用 49 次
- Optimality and Stability in Federated Learning: A Game-theoretic ApproachKate Donahue, Jon M. KleinbergNeurIPS 2021 · 被引用 74 次
- Fairness in model-sharing gamesKate Donahue, Jon M. KleinbergWWW 2023 · 被引用 12 次
- Collaboration Equilibrium in Federated LearningSen Cui, Jian Liang, Weishen Pan, Kun Chen 等KDD 2022 · 被引用 17 次
- FairTrade: Achieving Pareto-Optimal Trade-Offs between Balanced Accuracy and Fairness in Federated LearningMaryam Badar, Sandipan Sikdar, Wolfgang Nejdl, Marco FisichellaAAAI 2024 · 被引用 21 次
