From global to local MDI variable importances for random forests and when they are Shapley values
Antonio Sutera, Gilles Louppe, Vân Anh Huynh-Thu, Louis Wehenkel, Pierre Geurts
摘要
Random forests have been widely used for their ability to provide so-called importance measures, which give insight at a global (per dataset) level on the relevance of input variables to predict a certain output. On the other hand, methods based on Shapley values have been introduced to refine the analysis of feature relevance in tree-based models to a local (per instance) level. In this context, we first show that the global Mean Decrease of Impurity (MDI) variable importance scores correspond to Shapley values under some conditions. Then, we derive a local MDI importance measure of variable relevance, which has a very natural connection with the global MDI measure and can be related to a new notion of local feature relevance. We further link local MDI importances with Shapley values and discuss them in the light of related measures from the literature. The measures are illustrated through experiments on several classification and regression problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper2
- Understanding Global Feature Contributions With Additive Importance MeasuresIan Covert, Scott M. Lundberg, Su-In LeeNeurIPS 2020 · 被引用 476 次
- Explainable Matrix - Visualization for Global and Local Interpretability of Random Forest Classification EnsemblesMário Popolin Neto, Fernando V. PaulovichIEEE VIS 2020 · 被引用 120 次
相关 Paper
- Regional Explanations: Bridging Local and Global Variable ImportanceSalim I. Amoukou, Nicolas J.-B. BrunelNeurIPS 2025
- Accurate Estimation of Feature Importance Faithfulness for Tree ModelsMateusz Gajewski, Adam Karczmarz, Mateusz Rapicki, Piotr SankowskiAAAI 2025
- On Locality of Local Explanation ModelsSahra Ghalebikesabi, Lucile Ter-Minassian, Karla DiazOrdaz, Chris C. HolmesNeurIPS 2021 · 被引用 52 次
- Joint Shapley values: a measure of joint feature importanceChris Harris, Richard Pymar, Colin RowatICLR 2022 · 被引用 32 次
- Problems with Shapley-value-based explanations as feature importance measuresI. Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, Sorelle A. FriedlerICML 2020 · 被引用 458 次
