Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Tractable Shapley Values and Interactions via Tensor Networks

About

We show how to replace the O(2^n) coalition enumeration over n features behind Shapley values and Shapley-style interaction indices with a few-evaluation scheme on a tensor-network (TN) surrogate: TN-SHAP. The key idea is to represent a predictor's local behavior as a factorized multilinear map, so that coalitional quantities become linear probes of a coefficient tensor. TN-SHAP replaces exhaustive coalition sweeps with just a small number of targeted evaluations to extract order-k Shapley interactions. In particular, both order-1 (single-feature) and order-2 (pairwise) computations have cost O(n*poly(chi) + n^2), where chi is the TN's maximal cut rank. We provide theoretical guarantees on the approximation error and tractability of TN-SHAP. On UCI datasets, our method matches enumeration on the fitted surrogate while reducing evaluation by orders of magnitude and achieves 25-1000x wall-clock speedups over KernelSHAP-IQ at comparable accuracy, while amortizing training across local cohorts.

Farzaneh Heidari, Chao Li, Guillaume Rabusseau• 2025

Related benchmarks

TaskDatasetResultRank
Shapley interaction estimationDiabetes
Cosine Similarity99.37
50
Interaction value estimationDiabetes (test)
Time (s)0.0028
34
Runtime analysisSynthetic Multilinear Functions
Runtime (ms)3.5
10
Top-K feature recoverypoly5 synthetic function D=50
Top-K Accuracy84
1
Top-K feature recoverypoly5 synthetic function D=100
Top-K Accuracy90
1
Top-K feature recoverypoly10 D=50
Top-K Accuracy64
1
Top-K feature recoverypoly10 synthetic function D=100
Top-K Accuracy76
1
Top-K feature recoverysqexp synthetic function D=50
Top-K Recovery85
1
Top-K feature recoverysqexp synthetic function D=100
Top-K Accuracy98
1
Showing 9 of 9 rows

Other info

Follow for update