Cross-task Calibration for Asynchronous Federated Continual Learning
Yichen Li, Haozhao Wang, Hang Su, Yulong Li, xiaoquan Yi, Yankai Jiang, Chuang Zhao, Imran Razzak, Ruixuan Li
摘要
Federated Continual Learning (FCL) aims to empower distributed devices to learn a sequence of tasks over time. However, existing FCL research largely relies on the impractical assumption of synchronous new task arrival. This overlooks the reality of asynchronous user behavior and system latencies, forcing more efficient clients to endure costly inactivity. The practical necessity of an asynchronous method gives rise to Asynchronous Federated Continual Learning (AFCL). The server constantly receives a mixture of updates from clients at different time steps, leading to a catastrophic task drift that corrupts the global model and prevents effective learning. In this paper, we introduce a novel Cross-task Calibration framework called C-AFCL that is the first to tackle task drift at a semantic level within an Asynchronous FCL setting. Its core is a two-stage orthogonal calibration mechanism. First, intra-client calibration uses task-aware caches to mitigate variance from local client drift. Second, and more critically, inter-task interference calibration dynamically estimates an interference subspace from historical task knowledge. New updates are orthogonally projected to isolate and remove components that conflict with this subspace, preserving previous knowledge while learning new tasks. Extensive experiments show that C-AFCL significantly outperforms existing methods, demonstrating robust and efficient learning in dynamic federated environments.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper21
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang 等ICLR 2020 · 被引用 2,930 次
- Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee, Eunho Yang 等ICML 2021 · 被引用 303 次
- Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang, Gan Sun 等CVPR 2022 · 被引用 197 次
- Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonNeurIPS 2020 · 被引用 176 次
- FedCDA: Federated Learning with Cross-rounds Divergence-aware AggregationHaozhao Wang, Haoran Xu, Yichen Li, Yuan Xu 等ICLR 2024 · 被引用 62 次
相关 Paper
- RC-FCL: Combating Asynchronous Concept Drift in Federated Continual Learning via Retrospective CalibrationHang Su, Yijun Mo, Zhiyu Zhang, Yankai Jiang 等ICML 2026
- Taming Update Drift in Asynchronous Federated Learning via Orthogonal CalibrationJiayun Zhang, Shuheng Li, Haiyu Huang, Xiaofan Yu 等KDD 2026
- Federated Orthogonal Training: Mitigating Global Catastrophic Forgetting in Continual Federated LearningYavuz Faruk Bakman, Duygu Nur Yaldiz, Yahya H. Ezzeldin, Salman AvestimehrICLR 2024 · 被引用 27 次
- Traceable Federated Continual LearningQiang Wang, Bingyan Liu, Yawen LiCVPR 2024 · 被引用 16 次
- Federated Continual Learning via Orchestrating Multi-Scale ExpertiseXiaoyang Yi, Yang Liu, Binhan Yang, Jian Jun ZhangNeurIPS 2025
