Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Towards Robust and Reliable Algorithmic Recourse

About

As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan approvals), there has been growing interest in post hoc techniques which provide recourse to affected individuals. These techniques generate recourses under the assumption that the underlying predictive model does not change. However, in practice, models are often regularly updated for a variety of reasons (e.g., dataset shifts), thereby rendering previously prescribed recourses ineffective. To address this problem, we propose a novel framework, RObust Algorithmic Recourse (ROAR), that leverages adversarial training for finding recourses that are robust to model shifts. To the best of our knowledge, this work proposes the first solution to this critical problem. We also carry out detailed theoretical analysis which underscores the importance of constructing recourses that are robust to model shifts: 1) we derive a lower bound on the probability of invalidation of recourses generated by existing approaches which are not robust to model shifts. 2) we prove that the additional cost incurred due to the robust recourses output by our framework is bounded. Experimental evaluation on multiple synthetic and real-world datasets demonstrates the efficacy of the proposed framework and supports our theoretical findings.

Sohini Upadhyay, Shalmali Joshi, Himabindu Lakkaraju• 2021

Related benchmarks

TaskDatasetResultRank
Counterfactual Explanation Generationbanknote
R1
23
Counterfactual Explanation GenerationWine Quality
R Score0.994
23
Counterfactual Explanation GenerationDiabetes
R0.973
23
Counterfactual Explanation GenerationIris
R Score0.93
23
Counterfactual Explanation GenerationParkinsons
R1
20
Counterfactual ExplanationsPneumoniaMNIST (test)
IM11.155
16
Counterfactual ExplanationsCredit (test)
IM11.0285
16
Counterfactual ExplanationsSpam (test)
IM11.1588
16
Counterfactual ExplanationsBreast Cancer (test)
IM10.8164
16
Counterfactual ExplanationsMNIST (test)
IM1 Score1.4739
11
Showing 10 of 12 rows

Other info

Follow for update