Cross-task Calibration for Asynchronous Federated Continual Learning
Yichen Li, Haozhao Wang, Hang Su, Yulong Li, xiaoquan Yi, Yankai Jiang, Chuang Zhao, Imran Razzak, Ruixuan Li
Abstract
Federated Continual Learning (FCL) aims to empower distributed devices to learn a sequence of tasks over time. However, existing FCL research largely relies on the impractical assumption of synchronous new task arrival. This overlooks the reality of asynchronous user behavior and system latencies, forcing more efficient clients to endure costly inactivity. The practical necessity of an asynchronous method gives rise to Asynchronous Federated Continual Learning (AFCL). The server constantly receives a mixture of updates from clients at different time steps, leading to a catastrophic task drift that corrupts the global model and prevents effective learning. In this paper, we introduce a novel Cross-task Calibration framework called C-AFCL that is the first to tackle task drift at a semantic level within an Asynchronous FCL setting. Its core is a two-stage orthogonal calibration mechanism. First, intra-client calibration uses task-aware caches to mitigate variance from local client drift. Second, and more critically, inter-task interference calibration dynamically estimates an interference subspace from historical task knowledge. New updates are orthogonally projected to isolate and remove components that conflict with this subspace, preserving previous knowledge while learning new tasks. Extensive experiments show that C-AFCL significantly outperforms existing methods, demonstrating robust and efficient learning in dynamic federated environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on21
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee, Eunho Yang et al.ICML 2021 · 303 citations
- Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang, Gan Sun et al.CVPR 2022 · 197 citations
- Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonNeurIPS 2020 · 176 citations
- FedCDA: Federated Learning with Cross-rounds Divergence-aware AggregationHaozhao Wang, Haoran Xu, Yichen Li, Yuan Xu et al.ICLR 2024 · 62 citations
Related papers
- RC-FCL: Combating Asynchronous Concept Drift in Federated Continual Learning via Retrospective CalibrationHang Su, Yijun Mo, Zhiyu Zhang, Yankai Jiang et al.ICML 2026
- Taming Update Drift in Asynchronous Federated Learning via Orthogonal CalibrationJiayun Zhang, Shuheng Li, Haiyu Huang, Xiaofan Yu et al.KDD 2026
- Federated Orthogonal Training: Mitigating Global Catastrophic Forgetting in Continual Federated LearningYavuz Faruk Bakman, Duygu Nur Yaldiz, Yahya H. Ezzeldin, Salman AvestimehrICLR 2024 · 27 citations
- Traceable Federated Continual LearningQiang Wang, Bingyan Liu, Yawen LiCVPR 2024 · 16 citations
- Federated Continual Learning via Orchestrating Multi-Scale ExpertiseXiaoyang Yi, Yang Liu, Binhan Yang, Jian Jun ZhangNeurIPS 2025
