FedRAC: Rolling Submodel Allocation for Collaborative Fairness in Federated Learning
Zihui Wang, Yuhang Fu, Mengmeng Du, Zhimin Yuan, Yachen Liu, Weisheng Liao, Kaiyu Wang, Zheng Wang
Abstract
Collaborative fairness in federated learning ensures that clients are rewarded according to their contributions, thereby fostering long-term participation among clients. However, existing methods often under-reward lowcontributing clients in the early training stage and neglect critical issues (consistency across local models or unequal neuron training frequencies in the global model), leading to degraded performance. To address these issues, we propose FedRAC, a novel Federated learning framework employing Rolling submodel Allocation for Collaborative fairness, without compromising the global model performance. First, we design a dynamic reputation calculation module with a theoretical fairness guarantee to generate reputations matching clients' contributions. It adjusts their reputations dynamically during training, ensuring low-contribution clients access better models in the early stages for adequate training. Second, we propose a rolling submodel allocation module that assigns high-performance submodels to clients with high reputations. This module prioritizes low-frequency neurons during allocation and is supported by theoretical convergence guarantees, ensuring that all neurons in the global model are fully trained. Extensive experiments are conducted on four public datasets to confirm the advantages of our method in terms of fairness and model accuracy. The source code is available at https://github.com/ ZiHuiWangpcl1/FedRAC.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext db812e4c-8107-4860-8292-897e555c631fBuilds on21
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered DropoutSamuel Horváth, Stefanos Laskaridis, Mário Almeida, Ilias Leontiadis et al.NeurIPS 2021 · 390 citations
- FairFed: Enabling Group Fairness in Federated LearningYahya H. Ezzeldin, Shen Yan, Chaoyang He, Emilio Ferrara et al.AAAI 2023 · 310 citations
- FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and CorrectionLiang Gao, Huazhu Fu, Li Li, Yingwen Chen et al.CVPR 2022 · 307 citations
- HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous ClientsEnmao Diao, Jie Ding, Vahid TarokhICLR 2021 · 179 citations
Related papers
- FedSAC: Dynamic Submodel Allocation for Collaborative Fairness in Federated LearningZihui Wang, Zheng Wang, Lingjuan Lyu, Zhaopeng Peng et al.KDD 2024 · 6 citations
- Fair Federated Medical Image Segmentation via Client Contribution EstimationMeirui Jiang, Holger R. Roth, Wenqi Li, Dong Yang et al.CVPR 2023
- Incentive-Aware Federated Learning with Training-Time Model RewardsZhaoxuan Wu, Mohammad Mohammadi Amiri, Ramesh Raskar, Bryan Kian Hsiang LowICLR 2024 · 9 citations
- Aequa: Fair Model Rewards in Collaborative Learning via Slimmable NetworksNurbek Tastan, Samuel Horváth, Karthik NandakumarICML 2025
- FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated LearningJialuo He, Wei Chen, Xiaojin ZhangAAAI 2025 · 12 citations
