From Points to Coalitions: Hierarchical Contrastive Shapley Values for Prioritizing Data Samples
Canran Xiao, Jiabao Dou, Zhiming Lin, Zong Ke, Liwei Hou
Abstract
How should we quantify the value of each training example when datasets are large, heterogeneous, and geometrically structured? Classical Data-Shapley answers in principle, but its O(n!) complexity and point-wise perspective are ill-suited to modern scales. We propose Hierarchical Contrastive Data Valuation (HCDV), a three-stage framework that (i) learns a contrastive, geometry-preserving representation, (ii) organizes the data into a balanced coarse-to-fine hierarchy of clusters, and (iii) assigns Shapley-style pay-offs to coalitions via local Monte-Carlo games whose budgets are propagated downward. HCDV collapses the factorial burden to O(T∑ℓKℓ) = O(TKmax log n), rewards examples that sharpen decision boundaries, and regularizes outliers through curvature-based smoothness. We prove that HCDV approximately satisfies the four Shapley axioms with surplus loss O(η log n), enjoys sub-Gaussian coalition deviation Õ(1/√T), and incurs at most kε∞ regret for top-k selection. Experiments on four benchmarks — tabular, vision, streaming, and a 45 M-sample CTR task — plus the OpenDataVal suite show that HCDV lifts accuracy by up to +5 pp, slashes valuation time by up to 100×, and directly supports tasks such as augmentation filtering, low-latency streaming updates, and fair marketplace payouts.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 97dc3cdd-900a-4dd7-9732-05c6dee78a9bCited by top-tier papers6
- EEO-TFV: Escape-Explore Optimizer for Web-Scale Time-Series Forecasting and Vision AnalysisHua Wang, Jinghao Lu, Fan ZhangWWW 2026 · 6 citations
- TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series ForecastingFan Zhang, Shiming Fan, Hua WangACL 2026 · 4 citations
- CoMem: Compositional Concept-Graph Memory for Vision-Language AdaptationHeng Zhou, Jing Tang, Jusheng Zhang, Yanshu Li et al.ICLR 2026
- Sharpness-Aware Minimization for Generalized Embedding Learning in Federated RecommendationFengyuan Yu, Xiaohua Feng, Yuyuan Li, Changwang Zhang et al.WWW 2026
- Time-TK: A Multi-Offset Temporal Interaction Framework Combining Transformer and Kolmogorov-Arnold Networks for Time Series ForecastingFan Zhang, Shiming Fan, Hua WangWWW 2026
Builds on11
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates SpaceJiawei Yao, Chuming Li, Keqiang Sun, Yingjie Cai et al.ICCV 2023 · 150 citations
- Validation Free and Replication Robust Volume-based Data ValuationXinyi Xu, Zhaoxuan Wu, Chuan Sheng Foo, Bryan Kian Hsiang LowNeurIPS 2021 · 89 citations
- Improving Fairness for Data Valuation in Horizontal Federated LearningZhenan Fan, Huang Fang, Zirui Zhou, Jian Pei et al.ICDE 2022 · 68 citations
Related papers
- P-Shapley: Shapley Values on Probabilistic ClassifiersHaocheng Xia, Xiang Li, Junyuan Pang, Jinfei Liu et al.VLDB 2024
- HCDS: Hierarchical Clustering for Cold-Start Few-Shot Data SelectionYuhua Zhao, Zhixin Han, Xunzhi Wang, Bitong Luo et al.SIGIR 2025
- DU-Shapley: A Shapley Value Proxy for Efficient Dataset ValuationFelipe Garrido-Lucero, Benjamin Heymann, Maxime Vono, Patrick Loiseau et al.NeurIPS 2024 · 19 citations
- CS-Shapley: Class-wise Shapley Values for Data Valuation in ClassificationStephanie Schoch, Haifeng Xu, Yangfeng JiNeurIPS 2022 · 56 citations
- Counterfactual Explanation of the Shapley Value in Data CoalitionsMichelle Si, Jian PeiVLDB 2024 · 5 citations
