From Selection to Scheduling: Federated Geometry-Aware Correction Makes Exemplar Replay Work Better under Continual Dynamic Heterogeneity
Zhuang Qi, Ying-Peng Tang, Lei Meng, Guoqing Chao, Lei Wu, Han Yu, Xiangxu Meng
摘要
Exemplar replay has become an effective strategy for mitigating catastrophic forgetting in federated continual learning (FCL) by retaining representative samples from past tasks. Existing studies focus on designing sampleimportance estimation mechanisms to identify informationrich samples. However, they typically overlook strategies for effectively utilizing the selected exemplars, which limits their performance under continual dynamic heterogeneity across clients and tasks. To address this issue, this paper proposes a Federated gEometry-Aware correcTion method, termed FEAT, which alleviates imbalance-induced representation collapse that drags rare-class features toward frequent classes across clients. Specifically, it consists of two key modules: 1) the Geometric Structure Alignment module performs structural knowledge distillation by aligning the pairwise angular similarities between feature representations and their corresponding Equiangular Tight Frame prototypes, which are fixed and shared across clients to serve as a class-discriminative reference structure. This encourages geometric consistency across tasks and helps mitigate representation drift; 2) the Energy-based Geometric Correction module removes task-irrelevant directional components from feature embeddings, which reduces prediction bias toward majority classes. This improves sensitivity to minority classes and enhances the model's robustness under class-imbalanced distributions. Experimental results show that FEAT outperforms existing methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Cross-task Calibration for Asynchronous Federated Continual LearningYichen Li, Haozhao Wang, Hang Su, Yulong Li 等ICML 2026
- Cross-View Lewis Weight Fusion Empowering Exemplar Replay for Federated Class-Incremental LearningZhuang Qi, Yingpeng Tang, Lei Meng, Xiaoxiao Li 等ICML 2026
它引用的顶会 Paper43
- Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang, Gan Sun 等CVPR 2022 · 被引用 197 次
- FedGH: Heterogeneous Federated Learning with Generalized Global HeaderLiping Yi, Gang Wang, Xiaoguang Liu, Zhuan Shi 等ACM MM 2023 · 被引用 137 次
- TARGET: Federated Class-Continual Learning via Exemplar-Free DistillationJie Zhang, Chen Chen, Weiming Zhuang, Lingjuan LyuICCV 2023 · 被引用 109 次
- No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Synthetic and Fixed ClassifierZexi Li, Xinyi Shang, Rui He, Tao Lin 等ICCV 2023 · 被引用 81 次
- FedCDA: Federated Learning with Cross-rounds Divergence-aware AggregationHaozhao Wang, Haoran Xu, Yichen Li, Yuan Xu 等ICLR 2024 · 被引用 62 次
相关 Paper
- Accurate Forgetting for Heterogeneous Federated Continual LearningAbudukelimu Wuerkaixi, Sen Cui, Jingfeng Zhang, Kunda Yan 等ICLR 2024 · 被引用 25 次
- FedAGC: Federated Continual Learning with Asymmetric Gradient CorrectionChengchao Zhang, Fanhua Shang, Hongyin Liu, Liang Wan 等ICCV 2025 · 被引用 3 次
- Learn from Others and Be Yourself in Heterogeneous Federated LearningWenke Huang, Mang Ye, Bo DuCVPR 2022 · 被引用 254 次
- StructAlign: Structured Cross-Modal Alignment for Continual Text-to-Video RetrievalShaokun Wang, Weili Guan, Jizhou Han, Jianlong Wu 等SIGIR 2026
- Exemplar-Free Class Incremental Learning via Preserving Class-Discriminative StructureXin Zhang, Liang Bai, Guanchao Wang, Xian YangCVPR 2026
