BESplit: Bias-Compensated Split Federated Learning with Evidential Aggregation
Yuhan Xie, Chen Lyu, Jingrong Huang
摘要
Split Federated Learning (SFL) enables privacy-preserving collaborative training by partitioning models between clients and a server. However, under non-IID data distributions, SFL often suffers from biased optimization and unstable convergence, while existing solutions largely adapt techniques from conventional federated learning. In this work, we observe that the split architecture of SFL inherently alters how client information is represented and coordinated, opening opportunities for bias compensation beyond parameter-level aggregation. Based on this insight, we propose BESplit, an architecture-aware framework that exploits the intrinsic structure of SFL to mitigate non-IID effects. First, to prevent biased local data from dominating global updates, we introduce Evidential Aggregation (EA) to perform fine-grained reweighting of client contributions based on evidential uncertainty. Second, to further reduce distributional skew, we develop Bias-Compensated Collaboration (BCC) to align split-layer representations by pairing complementary clients. Finally, Dual-Teacher Distillation (DTD) is incorporated to synchronize knowledge between decoupled client and server models, enabling independent local inference. Extensive experiments on five benchmark datasets demonstrate that BESplit consistently outperforms state-of-the-art methods in accuracy, convergence stability, and computational efficiency under diverse non-IID settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- Compact Language Models via Pruning and Knowledge DistillationSaurav Muralidharan, Sharath Turuvekere Sreenivas, Raviraj Joshi, Marcin Chochowski 等NeurIPS 2024 · 被引用 198 次
- Logit Standardization in Knowledge DistillationShangquan Sun, Wenqi Ren, Jingzhi Li, Rui Wang 等CVPR 2024 · 被引用 183 次
- Federated Learning Based on Dynamic RegularizationDurmus Alp Emre Acar, Yue Zhao, Ramon Matas Navarro, Matthew Mattina 等ICLR 2021 · 被引用 114 次
- Post-hoc Uncertainty Learning Using a Dirichlet Meta-ModelMaohao Shen, Yuheng Bu, Prasanna Sattigeri, Soumya Ghosh 等AAAI 2023 · 被引用 51 次
相关 Paper
- FedCD: A Classifier Debiased Federated Learning Framework for Non-IID DataYunfei Long, Zhe Xue, Lingyang Chu, Tianlong Zhang 等ACM MM 2023 · 被引用 20 次
- Convergence Analysis of Split Federated Learning on Heterogeneous DataPengchao Han, Chao Huang, Geng Tian, Ming Tang 等NeurIPS 2024 · 被引用 32 次
- FedAlign: Differentially Private Distribution Alignment for Non-IID Federated LearningPeng Wu, Jiapeng Zhang, Yingjie Song, Xiong Xiao 等CVPR 2026
- Federated Learning for Non-IID Data via Unified Feature Learning and Optimization Objective AlignmentLin Zhang, Yong Luo, Yan Bai, Bo Du 等ICCV 2021 · 被引用 98 次
- Fair Federated Learning Under Domain Skew with Local Consistency and Domain DiversityYuhang Chen, Wenke Huang, Mang YeCVPR 2024
