ShapCCS: Shapley-Driven Client Coreset Selection in Federated Learning
Shuo Ji, Jie Hu, Zhouqiao He, Zijie Zhao, Tianrui Li, Jie Xu
Abstract
Computation overhead has emerged as a critical bottleneck in Federated Learning (FL). Coreset selection tackles this challenge by constructing an informative subset to represent the full dataset. However, existing approaches optimize coreset construction solely at the data level and enforce a uniform retention ratio across all clients, ignoring client heterogeneity and introducing detrimental fragmented clients. In this paper, we first introduce a gradient projection Shapley value (GPSV) to evaluate client contributions. GPSV captures both the directional and magnitude information of client updates and enables exact Shapley value calculation with per-coalition evaluation. Building on GPSV, we then propose ShapCCS, the first client-level coreset selection strategy for FL. ShapCCS prioritizes clients with high GPSV scores while excluding fragmented clients with negligible or even negative GPSV. As a client-level coreset selection strategy, ShapCCS can be integrated with a data-level selection approach, and additionally reduces communication costs, an advantage unattainable by data-level methods alone. Extensive experiments demonstrate the superiority of ShapCCS on model performance and robustness to noise. The code is available at https://anonymous.4open.science/r/ShapCCS-5CBB.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 438ec999-e79d-4097-92bf-a888809613d1Builds on16
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Deep Learning on a Data Diet: Finding Important Examples Early in TrainingMansheej Paul, Surya Ganguli, Gintare Karolina DziugaiteNeurIPS 2021 · 806 citations
- Coresets for Data-efficient Training of Machine Learning ModelsBaharan Mirzasoleiman, Jeff A. Bilmes, Jure LeskovecICML 2020 · 494 citations
- Identifying Mislabeled Data using the Area Under the Margin RankingGeoff Pleiss, Tianyi Zhang, Ethan R. Elenberg, Kilian Q. WeinbergerNeurIPS 2020 · 398 citations
- Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine LearningXinyi Xu, Lingjuan Lyu, Xingjun Ma, Chenglin Miao et al.NeurIPS 2021 · 133 citations
Related papers
- ShapleyFL: Robust Federated Learning Based on Shapley ValueQiheng Sun, Xiang Li, Jiayao Zhang, Li Xiong et al.KDD 2023 · 57 citations
- Game of Gradients: Mitigating Irrelevant Clients in Federated LearningLokesh Nagalapatti, Ramasuri NarayanamAAAI 2021 · 106 citations
- SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated LearningYi-Chung Chen, Hsi-Wen Chen, Shun-Gui Wang, Ming-Syan ChenNeurIPS 2023 · 11 citations
- Efficient Data Valuation Approximation in Federated Learning: A Sampling-Based ApproachShuyue Wei, Yongxin Tong, Zimu Zhou, Tianran He et al.ICDE 2025
- Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient CompressionZhida Jiang, Yang Xu, Hongli Xu, Zhiyuan Wang et al.INFOCOM 2023 · 43 citations
