ShapCCS: Shapley-Driven Client Coreset Selection in Federated Learning
Shuo Ji, Jie Hu, Zhouqiao He, Zijie Zhao, Tianrui Li, Jie Xu
摘要
Computation overhead has emerged as a critical bottleneck in Federated Learning (FL). Coreset selection tackles this challenge by constructing an informative subset to represent the full dataset. However, existing approaches optimize coreset construction solely at the data level and enforce a uniform retention ratio across all clients, ignoring client heterogeneity and introducing detrimental fragmented clients. In this paper, we first introduce a gradient projection Shapley value (GPSV) to evaluate client contributions. GPSV captures both the directional and magnitude information of client updates and enables exact Shapley value calculation with per-coalition evaluation. Building on GPSV, we then propose ShapCCS, the first client-level coreset selection strategy for FL. ShapCCS prioritizes clients with high GPSV scores while excluding fragmented clients with negligible or even negative GPSV. As a client-level coreset selection strategy, ShapCCS can be integrated with a data-level selection approach, and additionally reduces communication costs, an advantage unattainable by data-level methods alone. Extensive experiments demonstrate the superiority of ShapCCS on model performance and robustness to noise. The code is available at https://anonymous.4open.science/r/ShapCCS-5CBB.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang 等ICLR 2020 · 被引用 2,930 次
- Deep Learning on a Data Diet: Finding Important Examples Early in TrainingMansheej Paul, Surya Ganguli, Gintare Karolina DziugaiteNeurIPS 2021 · 被引用 806 次
- Coresets for Data-efficient Training of Machine Learning ModelsBaharan Mirzasoleiman, Jeff A. Bilmes, Jure LeskovecICML 2020 · 被引用 494 次
- Identifying Mislabeled Data using the Area Under the Margin RankingGeoff Pleiss, Tianyi Zhang, Ethan R. Elenberg, Kilian Q. WeinbergerNeurIPS 2020 · 被引用 398 次
- Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine LearningXinyi Xu, Lingjuan Lyu, Xingjun Ma, Chenglin Miao 等NeurIPS 2021 · 被引用 133 次
相关 Paper
- ShapleyFL: Robust Federated Learning Based on Shapley ValueQiheng Sun, Xiang Li, Jiayao Zhang, Li Xiong 等KDD 2023 · 被引用 57 次
- Game of Gradients: Mitigating Irrelevant Clients in Federated LearningLokesh Nagalapatti, Ramasuri NarayanamAAAI 2021 · 被引用 106 次
- SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated LearningYi-Chung Chen, Hsi-Wen Chen, Shun-Gui Wang, Ming-Syan ChenNeurIPS 2023 · 被引用 11 次
- Efficient Data Valuation Approximation in Federated Learning: A Sampling-Based ApproachShuyue Wei, Yongxin Tong, Zimu Zhou, Tianran He 等ICDE 2025
- Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient CompressionZhida Jiang, Yang Xu, Hongli Xu, Zhiyuan Wang 等INFOCOM 2023 · 被引用 43 次
