FedFSL-CFRD: Personalized Federated Few-Shot Learning with Collaborative Feature Representation Disentanglement
Shanfeng Wang, Jianzhao Li, Zaitian Liu, Yourun Zhang, Maoguo Gong
Abstract
Federated few-shot learning (FedFSL) aims to enable the clients to obtain personalized generalization models for unseen categories with only a small number of referenceable samples in the distributed collaborative training paradigm. Most existing FedFSL-related algorithms suffer from domain bias and feature coupling in the presence of data heterogeneity and sample scarcity. In this work, we propose a collaborative feature representation disentanglement (CFRD) scheme for FedFSL to address these issues. After each client receives the global aggregation parameters, the original feature representation is decoupled into global communal features and local personality features with personalized bias representation, to maintain both global consistency and local relevance in the first feature representation disentanglement. On the few-shot metric space about the second feature representation disentanglement, category-independent information is encoded by class-specific and class-irrelevant reconstructions to separate the discriminative features. The proposed scheme collaboratively accomplishes global domain bias feature disentanglement and local category degradation feature disentanglement from client-wise and class-wise. Extensive experiments on three few-shot benchmark datasets conforming to the FedFSL paradigm demonstrate that our proposed method outperforms state-of-the-art approaches in both global generality and local specificity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 85b384ad-008b-4bcf-b981-de1730115962Cited by top-tier papers2
- MPA: Multimodal Prototype Augmentation for Few-Shot LearningLiwen Wu, Wei Wang, Lei Zhao, Zhan Gao et al.AAAI 2026
- DDSF: Robust Few-Shot Learning via Disentangled Subspaces with Determinantal Point ProcessXulun Ye, Yifan Mei, Kun Zhou, Zelei Wu et al.CVPR 2026
Builds on17
- Tackling the Objective Inconsistency Problem in Heterogeneous Federated OptimizationJianyu Wang, Qinghua Liu, Hao Liang, Gauri Joshi et al.NeurIPS 2020 · 2,231 citations
- Ensemble Distillation for Robust Model Fusion in Federated LearningTao Lin, Lingjing Kong, Sebastian U. Stich, Martin JaggiNeurIPS 2020 · 1,615 citations
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 1,542 citations
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 1,081 citations
Related papers
- Disentangled Federated Learning for Tackling Attributes Skew via Invariant Aggregation and Diversity TransferringZhengquan Luo, Yunlong Wang, Zilei Wang, Zhenan Sun et al.ICML 2022 · 50 citations
- CD2-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated LearningYiqing Shen, Yuyin Zhou, Lequan YuCVPR 2022 · 69 citations
- Eliminating Domain Bias for Federated Learning in Representation SpaceJianqing Zhang, Yang Hua, Jian Cao, Hao Wang et al.NeurIPS 2023 · 105 citations
- FedPD: Federated Open Set Recognition with Parameter DisentanglementChen Yang, Meilu Zhu, Yifan Liu, Yixuan YuanICCV 2023 · 6 citations
- Domain-Skewed Federated Learning with Feature Decoupling and CalibrationHuan Wang, Jun Shen, Jun Yan, Guansong PangCVPR 2026
