Local Shapley: Model-Induced Locality and Optimal Reuse in Data Valuation
Xuan Yang, Hsi-Wen Chen, Ming-Syan Chen, Jian Pei
摘要
The Shapley value provides a principled foundation for data valuation, but exact computation is #P-hard due to the exponential coalition space. Existing accelerations remain global and ignore a structural property of modern predictors: for a given test instance, only a small subset of training points influences the prediction. We formalize this model-induced locality through support sets defined by the model's computational pathway (e.g., neighbors in KNN, leaves in trees, receptive fields in GNNs), showing that Shapley computation can be projected onto these supports without loss when locality is exact. This reframes Shapley evaluation as a structured data processing problem over overlapping support-induced subset families rather than exhaustive coalition enumeration. We prove that the intrinsic complexity of Local Shapley is governed by the number of distinct influential subsets, establishing an information-theoretic lower bound on retraining operations. Guided by this result, we propose LSMR ( L ocal S hapley via M odel R euse), an optimal subset-centric algorithm that trains each influential subset exactly once via support mapping and pivot scheduling. For larger supports, we develop LSMR-A , a reuse-aware Monte Carlo estimator that remains unbiased with exponential concentration, with runtime determined by the number of distinct sampled subsets rather than total draws. Experiments across multiple model families demonstrate substantial retraining reductions and speedups while preserving high valuation fidelity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 被引用 864 次
- Estimating Training Data Influence by Tracing Gradient DescentGarima Pruthi, Frederick Liu, Satyen Kale, Mukund SundararajanNeurIPS 2020 · 被引用 784 次
- Data Valuation using Reinforcement LearningJinsung Yoon, Sercan Ömer Arik, Tomas PfisterICML 2020 · 被引用 236 次
- Dealer: An End-to-End Model Marketplace with Differential PrivacyJinfei Liu, Jian Lou, Junxu Liu, Li Xiong 等VLDB 2021 · 被引用 99 次
- Measuring the Effect of Training Data on Deep Learning Predictions via Randomized ExperimentsJinkun Lin, Anqi Zhang, Mathias Lécuyer, Jinyang Li 等ICML 2022 · 被引用 70 次
相关 Paper
- Localized Data Shapley: Accelerating Valuation for Nearest Neighbor AlgorithmsGuangyi Zhang, Yanhao Wang, Chengliang Chai, Qiyu Liu 等NeurIPS 2025 · 被引用 1 次
- : Bayesian Experimental Design for Shapley Value EstimationDavid Rundel, Fabian Fumagalli, Maximilian Muschalik, Bernd Bischl 等ICML 2026
- CaSh: Shapley Value Computation with Cache OptimizationJiajun Tang, Xiaokai Mao, Ning Liu, Jinfei Liu 等VLDB 2026
- Shapley-Based Data Valuation for Weighted -Nearest NeighborsGuangyi Zhang, Qiyu Liu, Aristides GionisNeurIPS 2025 · 被引用 2 次
- Shapley-Guided Utility Learning for Effective Graph Inference Data ValuationHongliang Chi, Qiong Wu, Zhengyi Zhou, Yao MaICLR 2025
