Ripple Shapley: Data Influence Attribution in One Federated Training Run
Dewen Zeng, Wenlong Tian, Haozhao Wang, Jianfeng Lu, Weijun Xiao, Zhiyong Xu
摘要
Contribution evaluation is essential for incentivizing high-quality data sharing in federated learning (FL), yet existing Shapley-value-based methods are prohibitively expensive and overlook temporal influence propagation. In this paper, we propose Ripple Shapley, a novel attribution framework that enables accurate, real-time data valuation within a single federated training run. Our method decomposes each sample’s impact into an instantaneous drop term and a recursive ripple term, the latter capturing downstream influence via a Jacobian chain over global updates. To scale computation, we introduce a low-rank approximation of the Jacobian product and construct a shared subspace for efficient ripple accumulation. Extensive experiments on CIFAR-10 and MNIST show that Ripple Shapley achieves up to 62× speedup over existing Shapley-based FL methods while maintaining high attribution fidelity, significantly improving efficiency, robustness, and fairness in federated environments. We further demonstrate its effectiveness in dynamic federated learning scenarios and its potential for real-time data pricing.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang 等ICLR 2020 · 被引用 2,930 次
- Incentive Mechanism for Horizontal Federated Learning Based on Reputation and Reverse AuctionJingwen Zhang, Yuezhou Wu, Rong PanWWW 2021 · 被引用 176 次
- A Distributional Framework For Data ValuationAmirata Ghorbani, Michael P. Kim, James ZouICML 2020 · 被引用 152 次
- Game of Gradients: Mitigating Irrelevant Clients in Federated LearningLokesh Nagalapatti, Ramasuri NarayanamAAAI 2021 · 被引用 106 次
- FedCDA: Federated Learning with Cross-rounds Divergence-aware AggregationHaozhao Wang, Haoran Xu, Yichen Li, Yuan Xu 等ICLR 2024 · 被引用 62 次
相关 Paper
- FairFed: Improving Fairness and Efficiency of Contribution Evaluation in Federated Learning via Cooperative Shapley ValueYiqi Liu, Shan Chang, Ye Liu, Bo Li 等INFOCOM 2024 · 被引用 20 次
- Efficient Participant Contribution Evaluation for Horizontal and Vertical Federated LearningJunhao Wang, Lan Zhang, Anran Li, Xuanke You 等ICDE 2022 · 被引用 40 次
- SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated LearningYi-Chung Chen, Hsi-Wen Chen, Shun-Gui Wang, Ming-Syan ChenNeurIPS 2023 · 被引用 11 次
- Improving Fairness for Data Valuation in Horizontal Federated LearningZhenan Fan, Huang Fang, Zirui Zhou, Jian Pei 等ICDE 2022 · 被引用 68 次
- Fair and Efficient Contribution Valuation for Vertical Federated LearningZhenan Fan, Huang Fang, Xinglu Wang, Zirui Zhou 等ICLR 2024 · 被引用 33 次
