Flow-Disentangled Feature Importance
Xingshu Chen, Yifeng Guo, Jin-Hong Du
摘要
Feature importance (FI) measures are widely used to assess the contributions of predictors to an outcome, but they may target different notions of relevance. When predictors are correlated, traditional statistical FI methods are often tailored for feature selection and correlation can therefore be treated as conditional redundancy. By contrast, for model interpretation, FI is more naturally defined through marginal predictive relevance. In this context, we show that most existing approaches target identical population functionals under squared-error loss and exhibit correlation-induced bias. To address this limitation, we introduce Disentangled Feature Importance (DFI), a nonparametric generalization of the classical R 2 decomposition via canonical entropic optimal transport (EOT). DFI transforms correlated features into independent latent features using an EOT coupling for general covariate laws, including mixed and discrete settings. Importance scores are computed in this disentangled space and attributed back through the transition kernel's sensitivity. Under arbitrary feature dependencies, DFI provides a principled decomposition of latent importance scores that sum to the total predictive variability for latent additive models and to interaction-weighted functional ANOVA variances more generally. We develop semiparametric theory for DFI. Under the EOT formulation, we establish root-n consistency and asymptotic normality for nondegenerate importance estimators in the latent space and the original feature space. Notably, our estimators achieve second-order estimation error, which vanishes if both regression function and EOT kernel estimation errors are o P (n -1/4 ). By design, DFI avoids the computational burden of repeated submodel refitting and the challenges of conditional covariate distribution estimation, thereby achieving computational efficiency.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Efficient nonparametric statistical inference on population feature importance using Shapley valuesBrian D. Williamson, Jean FengICML 2020 · 被引用 86 次
- Statistically Valid Variable Importance Assessment through Conditional PermutationsAhmad Chamma, Denis A. Engemann, Bertrand ThirionNeurIPS 2023 · 被引用 23 次
- Variable Importance in High-Dimensional Settings Requires GroupingAhmad Chamma, Bertrand Thirion, Denis A. EngemannAAAI 2024 · 被引用 13 次
- Measuring Variable Importance in Heterogeneous Treatment Effects with ConfidenceJoseph Paillard, Angel David Reyero Lobo, Vitaliy Kolodyazhniy, Bertrand Thirion 等ICML 2025
- SPEX: Scaling Feature Interaction Explanations for LLMsJustin Singh Kang, Landon Butler, Abhineet Agarwal, Yigit Efe Erginbas 等ICML 2025
相关 Paper
- Sinkhorn Treatment Effects: A Causal Optimal Transport MeasureMedha Agarwal, Alex LuedtkeICML 2026
- Understanding Global Feature Contributions With Additive Importance MeasuresIan Covert, Scott M. Lundberg, Su-In LeeNeurIPS 2020 · 被引用 476 次
- Exact Functional ANOVA Decomposition for Categorical InputsBaptiste Ferrere, Nicolas Bousquet, Gamboa Fabrice, Jean-Michel Loubes 等ICML 2026 · 被引用 1 次
- Covered Information Disentanglement: Model Transparency via Unbiased Permutation ImportanceJoão P. B. Pereira, Erik S. G. Stroes, Aeilko H. Zwinderman, Evgeni LevinAAAI 2022 · 被引用 17 次
- A Differentiable Rank-Based Objective for Better Feature LearningKrunoslav Lehman Pavasovic, Giulio Biroli, Levent SagunICLR 2025
