Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Diffusion Models for Counterfactual Explanations

About

Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent diffusion models. By leveraging the guided generative diffusion process, our proposed methodology shows how to use the gradients of the target classifier to generate counterfactual explanations of input instances. Further, we analyze current approaches to evaluate spurious correlations and extend the evaluation measurements by proposing a new metric: Correlation Difference. Our experimental validations show that the proposed algorithm surpasses previous State-of-the-Art results on 5 out of 6 metrics on CelebA.

Guillaume Jeanneret, Lo\"ic Simon, Fr\'ed\'eric Jurie• 2022

Related benchmarks

TaskDatasetResultRank
Visual Counterfactual Explanation (Smile)CelebA Standard
FID3.17
11
Visual Counterfactual Explanation (Age)CelebA Standard
FID4.15
11
Counterfactual ExplanationImageNet Zebra - Sorrel
FID222.9
11
Counterfactual ExplanationImageNet (Cheetah - Cougar)
FID268.2
11
Counterfactual ExplanationImageNet Egyptian Cat - Persian Cat
FID322.8
11
Counterfactual Visual ExplanationBDD100K
FID7.94
10
Visual Counterfactual Explanation (Age)CelebA-HQ
FID18.7
9
Visual Counterfactual Explanation (Smile)CelebA-HQ
FID18.1
9
Counterfactual Visual ExplanationBDD-OIA
FID13.7
7
Counterfactual Visual Explanation (Age attribute)CelebA (test)
FID4.15
6
Showing 10 of 13 rows

Other info

Follow for update