Exact Functional ANOVA Decomposition for Categorical Inputs
Baptiste Ferrere, Nicolas Bousquet, Gamboa Fabrice, Jean-Michel Loubes, Joseph Muré
摘要
Functional ANOVA offers a principled framework for interpretability by decomposing a model's prediction into main effects and higher-order interactions. For independent features, this decomposition is well-defined, strongly linked with SHAP values, and serves as a cornerstone of additive explainability. However, the lack of an explicit closed-form expression for general dependent distributions has forced practitioners to rely on costly sampling-based approximations. We completely resolve this limitation for categorical inputs. By bridging functional analysis with the extension of discrete Fourier analysis, we derive a closedform decomposition without any assumption. Our formulation is computationally very efficient. It seamlessly recovers the classical independent case and extends to arbitrary dependence structures, including distributions with non-rectangular support. Furthermore, leveraging the intrinsic link between SHAP and ANOVA under independence, our framework yields a natural generalization of SHAP values for the general categorical setting. We provide a basic Python implementation of our method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Revisiting Deep Learning Models for Tabular DataYury Gorishniy, Ivan Rubachev, Valentin Khrulkov, Artem BabenkoNeurIPS 2021 · 被引用 1,847 次
- The Many Shapley Values for Model ExplanationMukund Sundararajan, Amir NajmiICML 2020 · 被引用 799 次
- On the Tractability of SHAP ExplanationsGuy Van den Broeck, Anton Lykov, Maximilian Schleich, Dan SuciuAAAI 2021 · 被引用 485 次
- Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD AlgorithmClément BénardNeurIPS 2025 · 被引用 7 次
- Bivariate Decision Trees: Smaller, Interpretable, More AccurateRasul Kairgeldin, Miguel Á. Carreira-PerpiñánKDD 2024 · 被引用 1 次
相关 Paper
- Fast Estimation of Partial Dependence Functions using TreesJinyang Liu, Tessa Steensgaard, Marvin N. Wright, Niklas Pfister 等ICML 2025
- Functional Decomposition and Shapley Interactions for Interpreting Survival ModelsSophie Hanna Langbein, Hubert Baniecki, Fabian Fumagalli, Niklas Koenen 等ICML 2026
- Tensor Product Neural Networks for Functional ANOVA ModelSeokhun Park, Insung Kong, Yongchan Choi, Chanmoo Park 等ICML 2025
- SHAP values via sparse Fourier representationAli Gorji, Andisheh Amrollahi, Andreas KrauseNeurIPS 2025 · 被引用 11 次
- Bayesian Neural Networks for Functional ANOVA ModelSeokhun Park, Choeun Kim, Jihu Lee, Yunseop Shin 等ICLR 2026
