Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics Aggregation
Zenghao Guan, Guojun Zhu, Yucan Zhou, Wu Liu, Weiping Wang, Jiebo Luo, Xiaoyan Gu
Abstract
The growing presence of mobile and IoT devices has led to massive decentralized and evolving data, driving the rise of Federated Learning (FL) to enable collaborative training without data sharing. However, traditional FL assumes static data distributions, which is unrealistic for dynamic real-world environments. To address this challenge, Federated Class-Incremental Learning (FCIL) has emerged as a promising framework that enables flexible adaptation to newly introduced classes over time. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid spatial-temporal client drift caused by data heterogeneity and often incur significant computational and communication overhead, limiting practical deployment. To address these challenges simultaneously, we propose a novel approach, Spatial-Temporal Statistics Aggregation (STSA), which provides a unified framework to aggregate feature statistics both spatially (across clients) and temporally (across stages). The aggregated feature statistics are unaffected by data heterogeneity and can be used to update the classifier in closed form at each stage. Additionally, we introduce STSA-E, a communication-efficient variant that enables the server to approximate global second-order feature statistics using first-order statistics uploaded from clients. Theoretical analysis shows that it achieves similar performance to STSA with much lower communication overhead. Extensive experiments on three widely used FCIL datasets, with varying degrees of data heterogeneity, show that our method outperforms state-of-the-art FCIL methods in terms of performance, flexibility, and both communication and computation efficiency. The code is available at https://github.com/Yuqin-G/STSA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on32
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- Data-Free Knowledge Distillation for Heterogeneous Federated LearningZhuangdi Zhu, Junyuan Hong, Jiayu ZhouICML 2021 · 957 citations
- No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID DataMi Luo, Fei Chen, Dapeng Hu, Yifan Zhang et al.NeurIPS 2021 · 510 citations
- Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated LearningLin Zhang, Li Shen, Liang Ding, Dacheng Tao et al.CVPR 2022 · 339 citations
Related papers
- pFedMxF: Personalized Federated Class-Incremental Learning with Mixture of Frequency AggregationYifei Zhang, Hao Zhu, Alysa Ziying Tan, Dianzhi Yu et al.CVPR 2025
- Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental LearningHao Yu, Xin Yang, Xin Gao, Yihui Feng et al.ACM MM 2024 · 13 citations
- FedASMU: Efficient Asynchronous Federated Learning with Dynamic Staleness-Aware Model UpdateJi Liu, Juncheng Jia, Tianshi Che, Chao Huo et al.AAAI 2024 · 87 citations
- Enabling Collaborative Test-Time Adaptation in Dynamic Environment via Federated LearningJiayuan Zhang, Xuefeng Liu, Yukang Zhang, Guogang Zhu et al.KDD 2024 · 6 citations
- CASA: Clustered Federated Learning with Asynchronous ClientsBoyi Liu, Yiming Ma, Zimu Zhou, Yexuan Shi et al.KDD 2024 · 10 citations
