FedARC: Anchor-Guided Residual Compensation for Data and Model Heterogeneous Federated Learning
Chentao Lu, Xuhao Ren, Dawei xu, Chuan Zhang, Liehuang Zhu
Abstract
Federated learning (FL) allows clients to collaboratively train models without exposing private data, but practical FL is simultaneously challenged by data heterogeneity and model heterogeneity. Prior heterogeneous FL (HtFL) approaches often fail to handle fine-grained feature shifts, leading to weak representation alignment and limited cross-client knowledge transfer, which degrades both personalization and generalization. We propose FedARC, an HtFL framework that couples a shared lightweight extractor with client-specific fusion: a trainable projector integrates local and global embeddings, while adaptive residual compensation dynamically corrects feature-level mismatches. To further stabilize aggregation, FedARC performs semantic anchor alignment across clients, and we theoretically prove FedARC converges with a non-convex convergence rate . Experiments on five public benchmarks show that FedARC outperforms nine state-of-the-art HtFL baselines by up to 2.63% in average accuracy, while maintaining efficient communication and computation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 20bf2940-84d6-4f87-878e-9d743b34f7a0Builds on24
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Federated Learning on Non-IID Data Silos: An Experimental StudyQinbin Li, Yiqun Diao, Quan Chen, Bingsheng HeICDE 2022 · 1,110 citations
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 1,081 citations
- Data-Free Knowledge Distillation for Heterogeneous Federated LearningZhuangdi Zhu, Junyuan Hong, Jiayu ZhouICML 2021 · 957 citations
Related papers
- pFedES: Generalized Proxy Feature Extractor Sharing for Model Heterogeneous Personalized Federated LearningLiping Yi, Han Yu, Chao Ren, Gang Wang et al.AAAI 2025 · 8 citations
- FedARA: Resource-adaptive Low-rank Personalized Federated Learning via Anchor-driven Representation Alignment on Heterogeneous Edge DevicesRuonan Zhao, Zheng Wang, Debin Liu, shijie lv et al.CVPR 2026
- FedProto: Federated Prototype Learning across Heterogeneous ClientsYue Tan, Guodong Long, Lu Liu, Tianyi Zhou et al.AAAI 2022 · 851 citations
- FedSC: Federated Learning with Semantic-Aware CollaborationHuan Wang, Haoran Li, Huaming Chen, Jun Yan et al.KDD 2025 · 1 citation
- Deploying Models to Non-participating Clients in Federated Learning without Fine-tuning: A Hypernetwork-based ApproachYuhao Zhou, Jindi Lv, Yuxin Tian, Dan Si et al.ICLR 2026 · 3 citations
