pFedMxF: Personalized Federated Class-Incremental Learning with Mixture of Frequency Aggregation
Yifei Zhang, Hao Zhu, Alysa Ziying Tan, Dianzhi Yu, Longtao Huang, Han Yu
摘要
Federated learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative machine learning. However, extending FL to class incremental learning settings introduces three key challenges: 1) spatial heterogeneity due to non-IID data distributions across clients, 2) temporal heterogeneity due to sequential arrival of tasks, and 3) resource heterogeneity due to diverse client capabilities. Existing approaches generally address these challenges in isolation, potentially leading to interference between updates, catastrophic forgetting or excessive communication overhead. In this paper, we propose personalized Federated class-incremental parameter efficient fine-tuning with Mixture of Frequency aggregation (pFedMxF), a novel framework that simultaneously addresses all three heterogeneity challenges through frequency domain decomposition. Our key insight is that assigning orthogonal frequency components to different clients and tasks enables interferencefree learning to be achieved with minimal communication costs. We further design an Auto-task Agnostic Classifier that automatically routes samples to task-specific classifiers while adapting to heterogeneous class distributions. We conduct extensive experiments on three benchmark datasets, comparing our approach with eight state-of-the-art methods. The results demonstrate that pFedMxF achieves comparable test accuracy, while requiring less model parameters and incurring significantly lower communication costs than baseline methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- CrossSpectra: Exploiting Cross-Layer Smoothness for Parameter-Efficient Fine-TuningYifei Zhang, Hao Zhu, Junhao Dong, Haoran Shi 等NeurIPS 2025 · 被引用 5 次
- ConSurv: Multimodal Continual Learning for Survival AnalysisDianzhi Yu, Conghao Xiong, Yankai Chen, Wenqian Cui 等AAAI 2026 · 被引用 2 次
- Spectral Mixture-of-Experts for Continual LearningChen Yin, Xingbo Dong, Xuelin Shen, Zhe JinCVPR 2026
- Smart Replay: Adaptive Scheduling of Memory Rehearsal for Computational Resource-Aware Incremental LearningJianting Chen, Dianzhi Yu, Irwin KingCVPR 2026
- FedMPT: Federated Multi-Label Prompt Tuning of Vision-Language ModelsXucong Wang, Pengkun Wang, Zhe Zhao, Liheng Yu 等CVPR 2026
它引用的顶会 Paper22
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 被引用 5,863 次
相关 Paper
- Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics AggregationZenghao Guan, Guojun Zhu, Yucan Zhou, Wu Liu 等WWW 2026
- Class-Wise Federated Averaging for Efficient PersonalizationGyuejeong Lee, Daeyoung ChoiICCV 2025 · 被引用 3 次
- Tackling Data Heterogeneity in Federated Learning with Class PrototypesYutong Dai, Zeyuan Chen, Junnan Li, Shelby Heinecke 等AAAI 2023 · 被引用 154 次
- Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental LearningHao Yu, Xin Yang, Xin Gao, Yihui Feng 等ACM MM 2024 · 被引用 13 次
- pFedAFM: Adaptive Feature Mixture for Data-Level Personalization in Heterogeneous Federated Learning on Mobile Edge DevicesLiping Yi, Han Yu, Gang Wang, Xiaoguang Liu 等ICDE 2025 · 被引用 4 次
