Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Sample Selection for Fair and Robust Training

About

Fairness and robustness are critical elements of Trustworthy AI that need to be addressed together. Fairness is about learning an unbiased model while robustness is about learning from corrupted data, and it is known that addressing only one of them may have an adverse affect on the other. In this work, we propose a sample selection-based algorithm for fair and robust training. To this end, we formulate a combinatorial optimization problem for the unbiased selection of samples in the presence of data corruption. Observing that solving this optimization problem is strongly NP-hard, we propose a greedy algorithm that is efficient and effective in practice. Experiments show that our algorithm obtains fairness and robustness that are better than or comparable to the state-of-the-art technique, both on synthetic and benchmark real datasets. Moreover, unlike other fair and robust training baselines, our algorithm can be used by only modifying the sampling step in batch selection without changing the training algorithm or leveraging additional clean data.

Yuji Roh, Kangwook Lee, Steven Euijong Whang, Changho Suh• 2021

Related benchmarks

TaskDatasetResultRank
Fair ClassificationSynthetic 1.0 (test)
Accuracy72.7
28
ClassificationAdultCensus (test)
Accuracy78.2
28
Fair ClassificationCOMPAS (test)
Accuracy54.5
28
ClassificationSynthetic Label Flipping (test)
Accuracy72.7
12
ClassificationGroup-Targeted Label Flipping synthetic (test)
Accuracy0.726
12
Showing 5 of 5 rows

Other info

Follow for update