Diffusion Models for Counterfactual Explanations
About
Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent diffusion models. By leveraging the guided generative diffusion process, our proposed methodology shows how to use the gradients of the target classifier to generate counterfactual explanations of input instances. Further, we analyze current approaches to evaluate spurious correlations and extend the evaluation measurements by proposing a new metric: Correlation Difference. Our experimental validations show that the proposed algorithm surpasses previous State-of-the-Art results on 5 out of 6 metrics on CelebA.
Guillaume Jeanneret, Lo\"ic Simon, Fr\'ed\'eric Jurie• 2022
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual Counterfactual Explanation (Smile) | CelebA Standard | FID3.17 | 11 | |
| Visual Counterfactual Explanation (Age) | CelebA Standard | FID4.15 | 11 | |
| Counterfactual Explanation | ImageNet Zebra - Sorrel | FID222.9 | 11 | |
| Counterfactual Explanation | ImageNet (Cheetah - Cougar) | FID268.2 | 11 | |
| Counterfactual Explanation | ImageNet Egyptian Cat - Persian Cat | FID322.8 | 11 | |
| Counterfactual Visual Explanation | BDD100K | FID7.94 | 10 | |
| Visual Counterfactual Explanation (Age) | CelebA-HQ | FID18.7 | 9 | |
| Visual Counterfactual Explanation (Smile) | CelebA-HQ | FID18.1 | 9 | |
| Counterfactual Visual Explanation | BDD-OIA | FID13.7 | 7 | |
| Counterfactual Visual Explanation (Age attribute) | CelebA (test) | FID4.15 | 6 |
Showing 10 of 13 rows