On the Tractability of SHAP Explanations
Guy Van den Broeck, Anton Lykov, Maximilian Schleich, Dan Suciu
Abstract
SHAP explanations are a popular feature-attribution mechanism for explainable AI. They use game-theoretic notions to measure the influence of individual features on the prediction of a machine learning model. Despite a lot of recent interest from both academia and industry, it is not known whether SHAP explanations of common machine learning models can be computed efficiently. In this paper, we establish the complexity of computing the SHAP explanation in three important settings. First, we consider fully-factorized data distributions, and show that the complexity of computing the SHAP explanation is the same as the complexity of computing the expected value of the model. This fully-factorized setting is often used to simplify the SHAP computation, yet our results show that the computation can be intractable for commonly used models such as logistic regression. Going beyond fully-factorized distributions, we show that computing SHAP explanations is already intractable for a very simple setting: computing SHAP explanations of trivial classifiers over naive Bayes distributions. Finally, we show that even computing SHAP over the empirical distribution is #P-hard.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c127b8d0-33f6-4f69-8b72-0f271cb9b231Cited by top-tier papers26
- FastSHAP: Real-Time Shapley Value EstimationNeil Jethani, Mukund Sudarshan, Ian Connick Covert, Su-In Lee et al.ICLR 2022 · 186 citations
- Additive MIL: Intrinsically Interpretable Multiple Instance Learning for PathologySyed Ashar Javed, Dinkar Juyal, Harshith Padigela, Amaro Taylor-Weiner et al.NeurIPS 2022 · 124 citations
- A Compositional Atlas of Tractable Circuit Operations for Probabilistic InferenceAntonio Vergari, YooJung Choi, Anji Liu, Stefano Teso et al.NeurIPS 2021 · 112 citations
- Explanations for Monotonic ClassifiersJoão Marques-Silva, Thomas Gerspacher, Martin C. Cooper, Alexey Ignatiev et al.ICML 2021 · 60 citations
- Explaining Predictive Uncertainty with Information Theoretic Shapley ValuesDavid S. Watson, Joshua O'Hara, Niek Tax, Richard Mudd et al.NeurIPS 2023 · 56 citations
Builds on3
- The Many Shapley Values for Model ExplanationMukund Sundararajan, Amir NajmiICML 2020 · 799 citations
- Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning SystemsAnupam Datta, Shayak Sen, Yair ZickS&P 2016 · 774 citations
- Problems with Shapley-value-based explanations as feature importance measuresI. Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, Sorelle A. FriedlerICML 2020 · 458 citations
Related papers
- Towards Trustable SHAP ScoresOlivier Létoffé, Xuanxiang Huang, João Marques-SilvaAAAI 2025 · 23 citations
- Provably Accurate Shapley Value Estimation via Leverage Score SamplingChristopher Musco, R. Teal WitterICLR 2025
- Additive Models Explained: A Computational Complexity ApproachShahaf Bassan, Michal Moshkovitz, Guy KatzNeurIPS 2025 · 4 citations
- On the Tractability of SHAP Explanations under Markovian DistributionsReda Marzouk, Colin de la HigueraICML 2024 · 13 citations
- The Tractability of SHAP-Score-Based Explanations for Classification over Deterministic and Decomposable Boolean CircuitsMarcelo Arenas, Pablo Barceló, Leopoldo E. Bertossi, Mikaël MonetAAAI 2021 · 37 citations
