Exact Functional ANOVA Decomposition for Categorical Inputs
Baptiste Ferrere, Nicolas Bousquet, Gamboa Fabrice, Jean-Michel Loubes, Joseph Muré
Abstract
Functional ANOVA offers a principled framework for interpretability by decomposing a model's prediction into main effects and higher-order interactions. For independent features, this decomposition is well-defined, strongly linked with SHAP values, and serves as a cornerstone of additive explainability. However, the lack of an explicit closed-form expression for general dependent distributions has forced practitioners to rely on costly sampling-based approximations. We completely resolve this limitation for categorical inputs. By bridging functional analysis with the extension of discrete Fourier analysis, we derive a closedform decomposition without any assumption. Our formulation is computationally very efficient. It seamlessly recovers the classical independent case and extends to arbitrary dependence structures, including distributions with non-rectangular support. Furthermore, leveraging the intrinsic link between SHAP and ANOVA under independence, our framework yields a natural generalization of SHAP values for the general categorical setting. We provide a basic Python implementation of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Revisiting Deep Learning Models for Tabular DataYury Gorishniy, Ivan Rubachev, Valentin Khrulkov, Artem BabenkoNeurIPS 2021 · 1,847 citations
- The Many Shapley Values for Model ExplanationMukund Sundararajan, Amir NajmiICML 2020 · 799 citations
- On the Tractability of SHAP ExplanationsGuy Van den Broeck, Anton Lykov, Maximilian Schleich, Dan SuciuAAAI 2021 · 485 citations
- Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD AlgorithmClément BénardNeurIPS 2025 · 7 citations
- Bivariate Decision Trees: Smaller, Interpretable, More AccurateRasul Kairgeldin, Miguel Á. Carreira-PerpiñánKDD 2024 · 1 citation
Related papers
- Fast Estimation of Partial Dependence Functions using TreesJinyang Liu, Tessa Steensgaard, Marvin N. Wright, Niklas Pfister et al.ICML 2025
- Functional Decomposition and Shapley Interactions for Interpreting Survival ModelsSophie Hanna Langbein, Hubert Baniecki, Fabian Fumagalli, Niklas Koenen et al.ICML 2026
- Tensor Product Neural Networks for Functional ANOVA ModelSeokhun Park, Insung Kong, Yongchan Choi, Chanmoo Park et al.ICML 2025
- SHAP values via sparse Fourier representationAli Gorji, Andisheh Amrollahi, Andreas KrauseNeurIPS 2025 · 11 citations
- Bayesian Neural Networks for Functional ANOVA ModelSeokhun Park, Choeun Kim, Jihu Lee, Yunseop Shin et al.ICLR 2026
