pFedMxF: Personalized Federated Class-Incremental Learning with Mixture of Frequency Aggregation
Yifei Zhang, Hao Zhu, Alysa Ziying Tan, Dianzhi Yu, Longtao Huang, Han Yu
Abstract
Federated learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative machine learning. However, extending FL to class incremental learning settings introduces three key challenges: 1) spatial heterogeneity due to non-IID data distributions across clients, 2) temporal heterogeneity due to sequential arrival of tasks, and 3) resource heterogeneity due to diverse client capabilities. Existing approaches generally address these challenges in isolation, potentially leading to interference between updates, catastrophic forgetting or excessive communication overhead. In this paper, we propose personalized Federated class-incremental parameter efficient fine-tuning with Mixture of Frequency aggregation (pFedMxF), a novel framework that simultaneously addresses all three heterogeneity challenges through frequency domain decomposition. Our key insight is that assigning orthogonal frequency components to different clients and tasks enables interferencefree learning to be achieved with minimal communication costs. We further design an Auto-task Agnostic Classifier that automatically routes samples to task-specific classifiers while adapting to heterogeneous class distributions. We conduct extensive experiments on three benchmark datasets, comparing our approach with eight state-of-the-art methods. The results demonstrate that pFedMxF achieves comparable test accuracy, while requiring less model parameters and incurring significantly lower communication costs than baseline methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65e50975-461b-4d42-a97f-34b52dd5733bCited by top-tier papers5
- CrossSpectra: Exploiting Cross-Layer Smoothness for Parameter-Efficient Fine-TuningYifei Zhang, Hao Zhu, Junhao Dong, Haoran Shi et al.NeurIPS 2025 · 5 citations
- ConSurv: Multimodal Continual Learning for Survival AnalysisDianzhi Yu, Conghao Xiong, Yankai Chen, Wenqian Cui et al.AAAI 2026 · 2 citations
- Spectral Mixture-of-Experts for Continual LearningChen Yin, Xingbo Dong, Xuelin Shen, Zhe JinCVPR 2026
- Smart Replay: Adaptive Scheduling of Memory Rehearsal for Computational Resource-Aware Incremental LearningJianting Chen, Dianzhi Yu, Irwin KingCVPR 2026
- FedMPT: Federated Multi-Label Prompt Tuning of Vision-Language ModelsXucong Wang, Pengkun Wang, Zhe Zhao, Liheng Yu et al.CVPR 2026
Builds on22
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 citations
Related papers
- Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics AggregationZenghao Guan, Guojun Zhu, Yucan Zhou, Wu Liu et al.WWW 2026
- Class-Wise Federated Averaging for Efficient PersonalizationGyuejeong Lee, Daeyoung ChoiICCV 2025 · 3 citations
- Tackling Data Heterogeneity in Federated Learning with Class PrototypesYutong Dai, Zeyuan Chen, Junnan Li, Shelby Heinecke et al.AAAI 2023 · 154 citations
- Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental LearningHao Yu, Xin Yang, Xin Gao, Yihui Feng et al.ACM MM 2024 · 13 citations
- pFedAFM: Adaptive Feature Mixture for Data-Level Personalization in Heterogeneous Federated Learning on Mobile Edge DevicesLiping Yi, Han Yu, Gang Wang, Xiaoguang Liu et al.ICDE 2025 · 4 citations
