Localized Data Shapley: Accelerating Valuation for Nearest Neighbor Algorithms
Guangyi Zhang, Yanhao Wang, Chengliang Chai, Qiyu Liu, Wei Wang
Abstract
Data Shapley values provide a principled approach for quantifying the contribution of individual training examples to machine learning models. However, computing these values often requires computational complexity that is exponential in the data size, and this has led researchers to pursue efficient algorithms tailored to specific machine learning models. Building on the prior success of the Shapley valuation for K -nearest neighbor (KNN) models, in this paper, we introduce a localized data Shapley framework that significantly accelerates the valuation of data points. Our approach leverages the distance-based local structure in the data space to decompose the global valuation problem into smaller, localized computations. Our primary contribution is an efficient valuation algorithm for a threshold-based KNN variant and shows that it provides provable speedups over the baseline under mild assumptions. Extensive experiments on real-life datasets demonstrate that our methods achieve a substantial speedup compared to previous approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Estimating Training Data Influence by Tracing Gradient DescentGarima Pruthi, Frederick Liu, Satyen Kale, Mukund SundararajanNeurIPS 2020 · 784 citations
- What Neural Networks Memorize and Why: Discovering the Long Tail via Influence EstimationVitaly Feldman, Chiyuan ZhangNeurIPS 2020 · 674 citations
- Scaling Up Influence FunctionsAndrea Schioppa, Polina Zablotskaia, David Vilar, Artem SokolovAAAI 2022 · 149 citations
- If You Like Shapley Then You'll Love the CoreTom Yan, Ariel D. ProcacciaAAAI 2021 · 85 citations
- Datamodels: Understanding Predictions with Data and Data with PredictionsAndrew Ilyas, Sung Min Park, Logan Engstrom, Guillaume Leclerc et al.ICML 2022 · 66 citations
Related papers
- Shapley-Based Data Valuation for Weighted -Nearest NeighborsGuangyi Zhang, Qiyu Liu, Aristides GionisNeurIPS 2025 · 2 citations
- Efficient Banzhaf-Based Data Valuation for k-Nearest Neighbors ClassificationGuangyi Zhang, Lutz Oettershagen, Lixu Wang, Aristides GionisVLDB 2026 · 1 citation
- A Distributional Framework For Data ValuationAmirata Ghorbani, Michael P. Kim, James ZouICML 2020 · 152 citations
- Local Shapley: Model-Induced Locality and Optimal Reuse in Data ValuationXuan Yang, Hsi-Wen Chen, Ming-Syan Chen, Jian PeiVLDB 2026 · 1 citation
- A Privacy-Friendly Approach to Data ValuationJiachen T. Wang, Yuqing Zhu, Yu-Xiang Wang, Ruoxi Jia et al.NeurIPS 2023 · 12 citations
