GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning
Jianqing Zhang, Yang Hua, Hao Wang, Tao Song, Zhengui Xue, Ruhui Ma, Jian Cao, Haibing Guan
Abstract
Federated Learning (FL) is popular for its privacy-preserving and collaborative learning capabilities. Recently, personalized FL (pFL) has received attention for its ability to address statistical heterogeneity and achieve personalization in FL. However, from the perspective of feature extraction, most existing pFL methods only focus on extracting global or personalized feature information during local training, which fails to meet the collaborative learning and personalization goals of pFL. To address this, we propose a new pFL method, named GPFL, to simultaneously learn global and personalized feature information on each client. We conduct extensive experiments on six datasets in three statistically heterogeneous settings and show the superiority of GPFL over ten state-of-the-art methods regarding effectiveness, scalability, fairness, stability, and privacy. Besides, GPFL mitigates overfitting and outperforms the baselines by up to 8.99% in accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers26
- FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated LearningJianqing Zhang, Yang Liu, Yang Hua, Jian CaoAAAI 2024 · 142 citations
- Eliminating Domain Bias for Federated Learning in Representation SpaceJianqing Zhang, Yang Hua, Jian Cao, Hao Wang et al.NeurIPS 2023 · 105 citations
- FedAS: Bridging Inconsistency in Personalized Federated LearningXiyuan Yang, Wenke Huang, Mang YeCVPR 2024 · 69 citations
- An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated LearningJianqing Zhang, Yang Liu, Yang Hua, Jian CaoCVPR 2024 · 24 citations
- A Swiss Army Knife for Heterogeneous Federated Learning: Flexible Coupling via Trace NormTianchi Liao, Lele Fu, Jialong Chen, Zhen Wang et al.NeurIPS 2024 · 23 citations
Builds on23
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Tackling the Objective Inconsistency Problem in Heterogeneous Federated OptimizationJianyu Wang, Qinghua Liu, Hao Liang, Gauri Joshi et al.NeurIPS 2020 · 2,231 citations
- Ensemble Distillation for Robust Model Fusion in Federated LearningTao Lin, Lingjing Kong, Sebastian U. Stich, Martin JaggiNeurIPS 2020 · 1,615 citations
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 1,542 citations
Related papers
- Understanding the Statistical Accuracy-Communication Trade-off in Personalized Federated Learning with Minimax GuaranteesXin Yu, Zelin He, Ying Sun, Lingzhou Xue et al.ICML 2025
- FedPall: Prototype-Based Adversarial and Collaborative Learning for Federated Learning with Feature DriftYong Zhang, Feng Liang, Guanghu Yuan, Min Yang et al.ICCV 2025 · 1 citation
- pFedES: Generalized Proxy Feature Extractor Sharing for Model Heterogeneous Personalized Federated LearningLiping Yi, Han Yu, Chao Ren, Gang Wang et al.AAAI 2025 · 8 citations
- FedCP: Separating Feature Information for Personalized Federated Learning via Conditional PolicyJianqing Zhang, Yang Hua, Hao Wang, Tao Song et al.KDD 2023 · 92 citations
- Tackling Feature-Classifier Mismatch in Federated Learning via Prompt-Driven Feature TransformationXinghao Wu, Xuefeng Liu, Jianwei Niu, Guogang Zhu et al.NeurIPS 2025 · 6 citations
