FedDAP: Domain-Aware Prototype Learning for Federated Learning under Domain Shift
Huy Q. Le, Loc X. Nguyen, Yu Qiao, Seong Tae Kim, Eui-Nam Huh, Choong Seon Hong
Abstract
Federated Learning (FL) enables decentralized model training across multiple clients without exposing private data, making it ideal for privacy-sensitive applications. However, in real-world FL scenarios, clients often hold data from distinct domains, leading to severe domain shift and degraded global model performance. To address this, prototype learning has been emerged as a promising solution, which leverages class-wise feature representations. Yet, existing methods face two key limitations: (1) Existing prototype-based FL methods typically construct a per class by aggregating local prototypes from all clients without preserving domain information. (2) Current feature-prototype alignment is , forcing clients to align with global prototypes regardless of domain origin. To address these challenges, we propose Federated Domain-Aware Prototypes (FedDAP) to construct domain-specific global prototypes by aggregating local client prototypes within the same domain using a similarity-weighted fusion mechanism. These global domain-specific prototypes are then used to guide local training by aligning local features with prototypes from the same domain, while encouraging separation from prototypes of different domains. This dual alignment enhances domain-specific learning at the local level and enables the global model to generalize across diverse domains. Finally, we conduct extensive experiments on three different datasets: DomainNet, Office-10, and PACS to demonstrate the effectiveness of our proposed framework to address the domain shift challenges.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on23
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Adaptive Federated OptimizationSashank J. Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett et al.ICLR 2021 · 1,917 citations
- Federated Learning with Matched AveragingHongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris S. Papailiopoulos et al.ICLR 2020 · 1,368 citations
- FedBN: Federated Learning on Non-IID Features via Local Batch NormalizationXiaoxiao Li, Meirui Jiang, Xiaofei Zhang, Michael Kamp et al.ICLR 2021 · 1,166 citations
Related papers
- Rethinking Federated Learning with Domain Shift: A Prototype ViewWenke Huang, Mang Ye, Zekun Shi, He Li et al.CVPR 2023
- Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data DomainsLei Wang, Jieming Bian, Letian Zhang, Chen Chen et al.NeurIPS 2024 · 36 citations
- Two Heads Are Better Than One: Generalized Cross-Domain Federated Learning via Dual-PrototypeMingsheng Cao, Tianci Chen, Ming Hu, Zhuang Qi et al.KDD 2026
- Bayesian Evidence-Driven Prototype Evolution for Federated Domain AdaptationXiaoyang Yi, Li Peng, Yuru Bao, Jian ZhangICLR 2026
- Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-TuningJingyuan Zhang, Yiyang Duan, Shuaicheng Niu, Yang Cao et al.ICLR 2025
