Distribution Alignment for One-Shot Federated Learning via Optimal Transport
Daniele Berardini, Vito Paolo Pastore, Vittorio Murino
摘要
One-Shot Federated Learning (OSFL) addresses extreme communication regimes in which clients interact with the server only once, amplifying the impact of heterogeneous client data distributions. In particular, the interaction of domain shift and label shift across clients induces misaligned feature representations that cannot be corrected through iterative optimization. Existing OSFL methods rely on distillation, server-side generation or ensemble-based aggregation, but assume aligned representations or address domain and label shift separately. We introduce SLOT-Align (Single-round, Learning-free Optimal Transport Alignment), a geometry-aware feature harmonization framework for OSFL. SLOT-Align uses a shared frozen encoder to extract compact feature statistics, constructs a global reference via Bures–Wasserstein barycenters, and aligns local representations using closed-form geodesic optimal transport maps. The method is computationally efficient and can be combined with existing OSFL pipelines relying on frozen encoders without modifying their training procedures. Extensive experiments across multiple benchmarks, pretrained backbones, and OSFL methods show that SLOT-Align consistently improves accuracy and robustness under joint domain and label shift.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang 等ICLR 2020 · 被引用 2,930 次
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang 等ICCV 2019 · 被引用 2,239 次
- Ensemble Distillation for Robust Model Fusion in Federated LearningTao Lin, Lingjing Kong, Sebastian U. Stich, Martin JaggiNeurIPS 2020 · 被引用 1,615 次
- Model Fusion via Optimal TransportSidak Pal Singh, Martin JaggiNeurIPS 2020 · 被引用 330 次
相关 Paper
- A Unified Solution to Diverse Heterogeneities in One-Shot Federated LearningJun Bai, Yiliao Song, Di Wu, Atul Sajjanhar 等KDD 2025
- FedTMOS: Efficient One-Shot Federated Learning with Tsetlin MachineShannon How Shi Qi, Jagmohan Chauhan, Geoff V. Merrett, Jonathon S. HareICLR 2025
- Feature-Aware One-Shot Federated Learning via Hierarchical Token SequencesShudong Liu, Hanwen Zhang, Xiuling Wang, Yuesheng Zhu 等AAAI 2026
- Data-Free One-Shot Federated Learning Under Very High Statistical HeterogeneityClare Elizabeth Heinbaugh, Emilio Luz-Ricca, Huajie ShaoICLR 2023
- DENSE: Data-Free One-Shot Federated LearningJie Zhang, Chen Chen, Bo Li, Lingjuan Lyu 等NeurIPS 2022 · 被引用 202 次
