XRAI: Better Attributions Through Regions
About
Saliency methods can aid understanding of deep neural networks. Recent years have witnessed many improvements to saliency methods, as well as new ways for evaluating them. In this paper, we 1) present a novel region-based attribution method, XRAI, that builds upon integrated gradients (Sundararajan et al. 2017), 2) introduce evaluation methods for empirically assessing the quality of image-based saliency maps (Performance Information Curves (PICs)), and 3) contribute an axiom-based sanity check for attribution methods. Through empirical experiments and example results, we show that XRAI produces better results than other saliency methods for common models and the ImageNet dataset.
Andrei Kapishnikov, Tolga Bolukbasi, Fernanda Vi\'egas, Michael Terry• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Feature Attribution Evaluation | ImageNet standard (val) | AUC76.5 | 39 | |
| Attribution Quality Evaluation | ImageNet (val) | SIC AUC0.755 | 30 | |
| Feature Attribution Evaluation | Open Images 5000 random images (val) | AUC0.631 | 13 | |
| Feature Attribution Evaluation | Diabetic Retinopathy (DR) 165 sample images (val) | AUC79.3 | 13 | |
| Attribution Quality Evaluation | Open Images (val) | SIC AUC0.843 | 10 |
Showing 5 of 5 rows