Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GLANCE: Global Actions in a Nutshell for Counterfactual Explainability

About

The widespread deployment of machine learning systems in critical real-world decision-making applications has highlighted the urgent need for counterfactual explainability methods that operate effectively. Global counterfactual explanations, expressed as actions to offer recourse, aim to provide succinct explanations and insights applicable to large population subgroups. High effectiveness, measured by the fraction of the population that is provided recourse, ensures that the actions benefit as many individuals as possible. Keeping the cost of actions low ensures the proposed recourse actions remain practical and actionable. Limiting the number of actions that provide global counterfactuals is essential to maximizing interpretability. The primary challenge, therefore, is to balance these trade-offs--maximizing effectiveness, minimizing cost, while maintaining a small number of actions. We introduce $\texttt{GLANCE}$, a versatile and adaptive algorithm that employs a novel agglomerative approach, jointly considering both the feature space and the space of counterfactual actions, thereby accounting for the distribution of points in a way that aligns with the model's structure. This design enables the careful balancing of the trade-offs among the three key objectives, with the size objective functioning as a tunable parameter to keep the actions few and easy to interpret. Our extensive experimental evaluation demonstrates that $\texttt{GLANCE}$ consistently shows greater robustness and performance compared to existing methods across various datasets and models.

Loukas Kavouras, Eleni Psaroudaki, Konstantinos Tsopelas, Dimitrios Rontogiannis, Nikolaos Theologitis, Dimitris Sacharidis, Giorgos Giannopoulos, Dimitrios Tomaras, Kleopatra Markou, Dimitrios Gunopulos, Dimitris Fotakis, Ioannis Emiris• 2024

Related benchmarks

TaskDatasetResultRank
Global Counterfactual ExplanationsDefault Credit
Effectiveness100
36
Global Counterfactual ExplanationsHELOC
Effectiveness100
36
Global Counterfactual ExplanationsGerman Credit
Effectiveness100
36
Global Counterfactual ExplanationsCOMPAS
Effectiveness100
36
Global Counterfactual ExplanationsAdult
Effectiveness100
30
Algorithmic RecourseGerman (10-fold cross-validation)
Recourse Cost (MPS)0.47
21
Recourse Cost EvaluationGerman Credit
Recourse Cost0.47
21
Algorithmic RecourseAttrition
Cost0.54
21
Algorithmic RecourseAttrition (10-fold cross-validation)
Recourse Cost (MPS)0.54
21
Counterfactual ExplanationsHELOC
Validity97
19
Showing 10 of 24 rows

Other info

Follow for update