FedScar: Correcting Geometric Bias for Flatness-Consistent Federated Learning
Jianfeng Lu, YuZhao Xiang, Yue Chen, Gang Li, Shuqin Cao, Guanghui Wen
摘要
Federated Learning (FL) often suffers from degraded generalization under statistical heterogeneity, where client updates systematically deviate from the global objective. While recent Sharpness-Aware Minimization (SAM) methods promote locally flat solutions, they implicitly assume that local flatness transfers to the global model, which generally does not hold under heterogeneous data distributions. This mismatch gives rise to a flatness discrepancy induced by misaligned loss landscapes. To address this issue, we propose FedScar, a federated optimization framework that explicitly corrects heterogeneityinduced geometric inconsistency. FedScar maintains a history-accumulated geometric bias to capture persistent curvature skew across clients, and employs a variance-aware injection mechanism to steer local updates toward regions that are flat with respect to the global objective. We provide a theoretical interpretation of FedScar as a Split-Dual ADMM formulation, which jointly enforces parameter consensus and geometric alignment. Extensive experiments under severe heterogeneity demonstrate that FedScar consistently reduces flatness discrepancy and improves generalization over state-of-the-art methods, without incurring additional communication overhead. The source code is available at https://github.com/ Ultraman6/FedScar.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- Sharpness-aware Minimization for Efficiently Improving GeneralizationPierre Foret, Ariel Kleiner, Hossein Mobahi, Behnam NeyshaburICLR 2021 · 被引用 1,861 次
- The Non-IID Data Quagmire of Decentralized Machine LearningKevin Hsieh, Amar Phanishayee, Onur Mutlu, Phillip B. GibbonsICML 2020 · 被引用 672 次
- No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID DataMi Luo, Fei Chen, Dapeng Hu, Yifan Zhang 等NeurIPS 2021 · 被引用 510 次
- Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin, Sangmin Bae 等NeurIPS 2022 · 被引用 235 次
相关 Paper
- Rethinking the Flat Minima Searching in Federated LearningTaehwan Lee, Sung Whan YoonICML 2024 · 被引用 10 次
- Flexible Sharpness-Aware Personalized Federated LearningXinda Xing, Qiugang Zhan, Xiurui Xie, Yuning Yang 等AAAI 2025 · 被引用 5 次
- One Arrow, Two Hawks: Sharpness-aware Minimization for Federated Learning via Global Model TrajectoryYuhang Li, Tong Liu, Yangguang Cui, Ming Hu 等ICML 2025
- Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth LandscapeYan Sun, Li Shen, Shixiang Chen, Liang Ding 等ICML 2023 · 被引用 69 次
- Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware MinimizationZiqing Fan, Shengchao Hu, Jiangchao Yao, Gang Niu 等ICML 2024 · 被引用 35 次
