Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

From global to local MDI variable importances for random forests and when they are Shapley values

About

Random forests have been widely used for their ability to provide so-called importance measures, which give insight at a global (per dataset) level on the relevance of input variables to predict a certain output. On the other hand, methods based on Shapley values have been introduced to refine the analysis of feature relevance in tree-based models to a local (per instance) level. In this context, we first show that the global Mean Decrease of Impurity (MDI) variable importance scores correspond to Shapley values under some conditions. Then, we derive a local MDI importance measure of variable relevance, which has a very natural connection with the global MDI measure and can be related to a new notion of local feature relevance. We further link local MDI importances with Shapley values and discuss them in the light of related measures from the literature. The measures are illustrated through experiments on several classification and regression problems.

Antonio Sutera, Gilles Louppe, Van Anh Huynh-Thu, Louis Wehenkel, Pierre Geurts• 2021

Related benchmarks

TaskDatasetResultRank
Local Feature Importance Evaluation12 Real-World Datasets Aggregate (test)
Average Rank3.5
16
Counterfactual ExplanationsSpam (test)--
16
ClassificationHouse 16H (full)
AUROC68.73
9
RegressionSuper Conductivity N=21,263 (full)
R2 Score0.6564
9
RegressionSARCOS N=48,933 (full)
R2 Score0.861
9
RegressionWave Energy N=72,000 (full)
R2 Score0.4935
9
ClassificationPol N=10,082 (full)
AUROC0.9396
9
ClassificationMiami Housing N=13,932 (full)
AUROC-0.2378
9
Counterfactual Explanationpol (test)
Mean L1 Distance11.2
4
Counterfactual ExplanationOzone (test)
Mean L1 Distance39
4
Showing 10 of 13 rows

Other info

Code

Follow for update