Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GLOBE-CE: A Translation-Based Approach for Global Counterfactual Explanations

About

Counterfactual explanations have been widely studied in explainability, with a range of application dependent methods prominent in fairness, recourse and model understanding. The major shortcoming associated with these methods, however, is their inability to provide explanations beyond the local or instance-level. While many works touch upon the notion of a global explanation, typically suggesting to aggregate masses of local explanations in the hope of ascertaining global properties, few provide frameworks that are both reliable and computationally tractable. Meanwhile, practitioners are requesting more efficient and interactive explainability tools. We take this opportunity to propose Global & Efficient Counterfactual Explanations (GLOBE-CE), a flexible framework that tackles the reliability and scalability issues associated with current state-of-the-art, particularly on higher dimensional datasets and in the presence of continuous features. Furthermore, we provide a unique mathematical analysis of categorical feature translations, utilising it in our method. Experimental evaluation with publicly available datasets and user studies demonstrate that GLOBE-CE performs significantly better than the current state-of-the-art across multiple metrics (e.g., speed, reliability).

Dan Ley, Saumitra Mishra, Daniele Magazzeni• 2023

Related benchmarks

TaskDatasetResultRank
Global Counterfactual ExplanationsHELOC
Effectiveness100
36
Global Counterfactual ExplanationsCOMPAS
Effectiveness100
36
Global Counterfactual ExplanationsDefault Credit
Effectiveness99.95
36
Global Counterfactual ExplanationsGerman Credit
Effectiveness98.09
36
Global Counterfactual ExplanationsAdult
Effectiveness100
30
Algorithmic RecourseAttrition
Cost0.75
21
Algorithmic RecourseAttrition (10-fold cross-validation)
Recourse Cost (MPS)0.75
21
Algorithmic RecourseGerman (10-fold cross-validation)
Recourse Cost (MPS)0.91
21
Recourse Cost EvaluationGerman Credit
Recourse Cost0.91
21
Counterfactual ExplanationsHELOC
Validity100
19
Showing 10 of 55 rows

Other info

Follow for update