Fair-FedMOE: Group-Fair One-Shot Federated Learning via Prototype-Guided Experts for Medical Imaging Analysis
Lingzhao Meng, Shuai Guo, Weishan Zhang, Zengxiang Li, Han Yu, Nan Liu, Daniel Ting, Yuru Liu, Shudong Wang, Tao Chen
Abstract
Group fairness can ensure equitable performance across different demographic subgroups for medical image analysis. However, the current fine-tuned foundation models (FMs) exhibit significant subgroup disparity. One-shot federated learning (OFL) can potentially mitigate this by leveraging cross-institutional data diversity within a single communication round. However, heterogeneous distributions across medical institutions may cause OFL local models to diverge severely, resulting in parameter conflicts that amplify disparity upon aggregation. To address these challenges, we propose Fair-FedMOE, a group-fair OFL framework for medical FMs. During local training, Fairness-aware Expert Routing leverages learnable prototypes to route samples to group-specific experts, enabling subgroup-specialized learning to capture group-specific features without inter-group interference. During model aggregation, Prototype-guided Differential Aggregation computes personalized weights based on prototype similarity and applies differentiated aggregation strategies to filter conflicting updates. We propose RES-AUC, a Rawlsian justice-inspired metric based on worst-group performance that remains stable as groups increase. Extensive experiments on retinal and chest X-ray datasets with multiple FMs demonstrate consistent fairness gains without sacrificing accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d4c27e21-5598-44b9-ab5b-8af84488bc6aBuilds on18
- DENSE: Data-Free One-Shot Federated LearningJie Zhang, Chen Chen, Bo Li, Lingjuan Lyu et al.NeurIPS 2022 · 202 citations
- Addressing Algorithmic Disparity and Performance Inconsistency in Federated LearningSen Cui, Weishen Pan, Jian Liang, Changshui Zhang et al.NeurIPS 2021 · 112 citations
- No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Synthetic and Fixed ClassifierZexi Li, Xinyi Shang, Rui He, Tao Lin et al.ICCV 2023 · 81 citations
- No Prejudice! Fair Federated Graph Neural Networks for Personalized RecommendationNimesh Agrawal, Anuj Kumar Sirohi, Sandeep Kumar, JayadevaAAAI 2024 · 44 citations
- FairCLIP: Harnessing Fairness in Vision-Language LearningYan Luo, Min Shi, Muhammad Osama Khan, Muhammad Muneeb Afzal et al.CVPR 2024 · 37 citations
Related papers
- FairFed: Enabling Group Fairness in Federated LearningYahya H. Ezzeldin, Shen Yan, Chaoyang He, Emilio Ferrara et al.AAAI 2023 · 310 citations
- dFLMoE: Decentralized Federated Learning via Mixture of Experts for Medical Data AnalysisLuyuan Xie, Tianyu Luan, Wenyuan Cai, Guochen Yan et al.CVPR 2025
- Distribution-aware Fairness Learning in Medical Image Segmentation From A Control-Theoretic PerspectiveYujin Oh, Pengfei Jin, Sangjoon Park, Sekeun Kim et al.ICML 2025
- Towards Collaborative Fairness in Federated Learning Under Imbalanced Covariate ShiftTianrun Yu, Jiaqi Wang, Haoyu Wang, Mingquan Lin et al.KDD 2025
- FairTrade: Achieving Pareto-Optimal Trade-Offs between Balanced Accuracy and Fairness in Federated LearningMaryam Badar, Sandipan Sikdar, Wolfgang Nejdl, Marco FisichellaAAAI 2024 · 21 citations
