Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Linear TreeShap

About

Decision trees are well-known due to their ease of interpretability. To improve accuracy, we need to grow deep trees or ensembles of trees. These are hard to interpret, offsetting their original benefits. Shapley values have recently become a popular way to explain the predictions of tree-based machine learning models. It provides a linear weighting to features independent of the tree structure. The rise in popularity is mainly due to TreeShap, which solves a general exponential complexity problem in polynomial time. Following extensive adoption in the industry, more efficient algorithms are required. This paper presents a more efficient and straightforward algorithm: Linear TreeShap. Like TreeShap, Linear TreeShap is exact and requires the same amount of memory.

Peng Yu, Chao Xu, Albert Bifet, Jesse Read• 2022

Related benchmarks

TaskDatasetResultRank
Tree Explainer Runtime and Stability AnalysisSynthetic data d=100
Runtime (ms)0.016
72
TreeSHAP ExplanationSynthetic d=10
Runtime (ms)0.015
41
Tree Explainer Runtime and Stability AnalysisSynthetic data d=10
Runtime (ms)0.015
29
Text ClassificationEmotion
Execution Time (ms)43.2
6
Text Classificationsms_spam
Execution time (ms)10.8
6
Tree ExplanationEmotion
Runtime (ms/instance)43.2
6
Tree ExplanationSMS Spam
Runtime (ms/instance)10.8
6
Text ClassificationIMDB
Execution Time (ms)6.76
5
Text ClassificationSST2
Execution Time (ms)87.4
5
Text ClassificationRT
Execution Time (ms)43.3
5
Showing 10 of 13 rows

Other info

Follow for update