Ripple Shapley: Data Influence Attribution in One Federated Training Run
Dewen Zeng, Wenlong Tian, Haozhao Wang, Jianfeng Lu, Weijun Xiao, Zhiyong Xu
Abstract
Contribution evaluation is essential for incentivizing high-quality data sharing in federated learning (FL), yet existing Shapley-value-based methods are prohibitively expensive and overlook temporal influence propagation. In this paper, we propose Ripple Shapley, a novel attribution framework that enables accurate, real-time data valuation within a single federated training run. Our method decomposes each sample’s impact into an instantaneous drop term and a recursive ripple term, the latter capturing downstream influence via a Jacobian chain over global updates. To scale computation, we introduce a low-rank approximation of the Jacobian product and construct a shared subspace for efficient ripple accumulation. Extensive experiments on CIFAR-10 and MNIST show that Ripple Shapley achieves up to 62× speedup over existing Shapley-based FL methods while maintaining high attribution fidelity, significantly improving efficiency, robustness, and fairness in federated environments. We further demonstrate its effectiveness in dynamic federated learning scenarios and its potential for real-time data pricing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 683d345e-2ce6-4a09-9ab2-3acc78e7e6d5Builds on9
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Incentive Mechanism for Horizontal Federated Learning Based on Reputation and Reverse AuctionJingwen Zhang, Yuezhou Wu, Rong PanWWW 2021 · 176 citations
- A Distributional Framework For Data ValuationAmirata Ghorbani, Michael P. Kim, James ZouICML 2020 · 152 citations
- Game of Gradients: Mitigating Irrelevant Clients in Federated LearningLokesh Nagalapatti, Ramasuri NarayanamAAAI 2021 · 106 citations
- FedCDA: Federated Learning with Cross-rounds Divergence-aware AggregationHaozhao Wang, Haoran Xu, Yichen Li, Yuan Xu et al.ICLR 2024 · 62 citations
Related papers
- FairFed: Improving Fairness and Efficiency of Contribution Evaluation in Federated Learning via Cooperative Shapley ValueYiqi Liu, Shan Chang, Ye Liu, Bo Li et al.INFOCOM 2024 · 20 citations
- Efficient Participant Contribution Evaluation for Horizontal and Vertical Federated LearningJunhao Wang, Lan Zhang, Anran Li, Xuanke You et al.ICDE 2022 · 40 citations
- SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated LearningYi-Chung Chen, Hsi-Wen Chen, Shun-Gui Wang, Ming-Syan ChenNeurIPS 2023 · 11 citations
- Improving Fairness for Data Valuation in Horizontal Federated LearningZhenan Fan, Huang Fang, Zirui Zhou, Jian Pei et al.ICDE 2022 · 68 citations
- Fair and Efficient Contribution Valuation for Vertical Federated LearningZhenan Fan, Huang Fang, Xinglu Wang, Zirui Zhou et al.ICLR 2024 · 33 citations
