Personalized Bayesian Federated Learning with Wasserstein Barycenter Aggregation
Ting Wei, Biao Mei, Junliang Lyu, Renquan Zhang, Feng Zhou, Yifan Sun
Abstract
Personalized Bayesian federated learning (PBFL) handles non-i.i.d. client data and quantifies uncertainty by combining personalization with Bayesian inference. However, existing PBFL methods face two limitations: restrictive parametric assumptions in client posterior inference and naive parameter averaging for server aggregation. To overcome these issues, we propose FedWBA, a novel PBFL method that enhances both local inference and global aggregation. At the client level, we use particle-based variational inference for nonparametric posterior representation. At the server level, we introduce particle-based Wasserstein barycenter aggregation, offering a more geometrically meaningful approach. Theoretically, we provide local and global convergence guarantees for FedWBA. Locally, we prove a KL divergence decrease lower bound per iteration for variational inference convergence. Globally, we show that the Wasserstein barycenter converges to the true parameter as the client data size increases. Empirically, experiments show that FedWBA outperforms baselines in prediction accuracy, uncertainty calibration, and convergence rate, with ablation studies confirming its robustness.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b5a56b12-acd7-4dc6-90a5-4772c25cc3a3Cited by top-tier papers1
Ask how each one uses itBuilds on11
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Tackling the Objective Inconsistency Problem in Heterogeneous Federated OptimizationJianyu Wang, Qinghua Liu, Hao Liang, Gauri Joshi et al.NeurIPS 2020 · 2,231 citations
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 1,542 citations
- Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning ApproachAlireza Fallah, Aryan Mokhtari, Asuman E. OzdaglarNeurIPS 2020 · 1,354 citations
Related papers
- Personalized Federated Learning via Variational Bayesian InferenceXu Zhang, Yinchuan Li, Wenpeng Li, Kaiyang Guo et al.ICML 2022 · 132 citations
- Harnessing Heterogeneous Statistical Strength for Personalized Federated Learning via Hierarchical Bayesian InferenceMahendra Singh Thapa, Rui LiICML 2025
- Confidence-Aware Personalized Federated Learning via Variational Expectation MaximizationJunyi Zhu, Xingchen Ma, Matthew B. BlaschkoCVPR 2023
- Federated Learning via Meta-Variational DropoutInsu Jeon, Minui Hong, Junhyeog Yun, Gunhee KimNeurIPS 2023 · 11 citations
- Federated Learning via Posterior Averaging: A New Perspective and Practical AlgorithmsMaruan Al-Shedivat, Jennifer Gillenwater, Eric P. Xing, Afshin RostamizadehICLR 2021 · 38 citations
