Class-wise Balancing Data Replay for Federated Class-Incremental Learning
Zhuang Qi, Ying-Peng Tang, Lei Meng, Han Yu, Xiaoxiao Li, Xiangxu Meng
Abstract
Federated Class Incremental Learning (FCIL) aims to collaboratively process continuously increasing incoming tasks across multiple clients. Among various approaches, data replay has become a promising solution, which can alleviate forgetting by reintroducing representative samples from previous tasks. However, their performance is typically limited by class imbalance, both within the replay buffer due to limited global awareness and between replayed and newly arrived classes. To address this issue, we propose a class wise balancing data replay method for FCIL (FedCBDR), which employs a global coordination mechanism for class-level memory construction and reweights the learning objective to alleviate the aforementioned imbalances. Specifically, FedCBDR has two key components: 1) the global-perspective data replay module reconstructs global representations of prior task in a privacy-preserving manner, which then guides a class-aware and importance-sensitive sampling strategy to achieve balanced replay; 2) Subsequently, to handle class imbalance across tasks, the task aware temperature scaling module adaptively adjusts the temperature of logits at both class and instance levels based on task dynamics, which reduces the model's overconfidence in majority classes while enhancing its sensitivity to minority classes. Experimental results verified that FedCBDR achieves balanced class-wise sampling under heterogeneous data distributions and improves generalization under task imbalance between earlier and recent tasks, yielding a 2%-15% Top-1 accuracy improvement over six state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Bring Your Dreams to Life: Continual Text-to-Video CustomizationJiahua Dong, Xudong Wang, Wenqi Liang, Zongyan Han et al.AAAI 2026 · 1 citation
- Explicit Modeling of Causal Factors and Confounders for Image ClassificationWei Wu, Lei Meng, Zhuang Qi, Zixuan Li et al.AAAI 2026
- Decouple Your Discovery and Memory in Continual Generalized Category DiscoveryJiawei Yu, Zijian Gao, Xingxing Zhang, Xuan Liu et al.CVPR 2026
- Cross-task Calibration for Asynchronous Federated Continual LearningYichen Li, Haozhao Wang, Hang Su, Yulong Li et al.ICML 2026
- Cross-View Lewis Weight Fusion Empowering Exemplar Replay for Federated Class-Incremental LearningZhuang Qi, Yingpeng Tang, Lei Meng, Xiaoxiao Li et al.ICML 2026
Builds on28
- Learning with Twin Noisy Labels for Visible-Infrared Person Re-IdentificationMouxing Yang, Zhenyu Huang, Peng Hu, Taihao Li et al.CVPR 2022 · 248 citations
- Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang, Gan Sun et al.CVPR 2022 · 197 citations
- FedGH: Heterogeneous Federated Learning with Generalized Global HeaderLiping Yi, Gang Wang, Xiaoguang Liu, Zhuan Shi et al.ACM MM 2023 · 137 citations
- TARGET: Federated Class-Continual Learning via Exemplar-Free DistillationJie Zhang, Chen Chen, Weiming Zhuang, Lingjuan LyuICCV 2023 · 109 citations
- A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision TasksSara Babakniya, Zalan Fabian, Chaoyang He, Mahdi Soltanolkotabi et al.NeurIPS 2023 · 100 citations
Related papers
- Federated Class-Incremental Learning: A Hybrid Approach Using Latent Exemplars and Data-Free Techniques to Address Local and Global ForgettingMilad Khademi Nori, Il-Min Kim, Guanghui WangICLR 2025
- Defying Imbalanced Forgetting in Class Incremental LearningShixiong Xu, Gaofeng Meng, Xing Nie, Bolin Ni et al.AAAI 2024 · 8 citations
- Towards Efficient Replay in Federated Incremental LearningYichen Li, Qunwei Li, Haozhao Wang, Ruixuan Li et al.CVPR 2024
- Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental LearningHao Yu, Xin Yang, Xin Gao, Yihui Feng et al.ACM MM 2024 · 13 citations
- Lightweight Federated Incremental Learning via Decoupled ReplayXiuying Wang, Yichen Li, Hang Su, Gaozhuo Liu et al.ICML 2026
