Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Concolic Testing on Individual Fairness of Neural Network Models

About

This paper introduces PyFair, a formal framework for evaluating and verifying individual fairness of Deep Neural Networks (DNNs). By adapting the concolic testing tool PyCT, we generate fairness-specific path constraints to systematically explore DNN behaviors. Our key innovation is a dual network architecture that enables comprehensive fairness assessments and provides completeness guarantees for certain network types. We evaluate PyFair on 25 benchmark models, including those enhanced by existing bias mitigation techniques. Results demonstrate PyFair's efficacy in detecting discriminatory instances and verifying fairness, while also revealing scalability challenges for complex models. This work advances algorithmic fairness in critical domains by offering a rigorous, systematic method for fairness testing and verification of pre-trained DNNs.

Ming-I Huang, Chih-Duo Hong, Fang Yu• 2025

Related benchmarks

TaskDatasetResultRank
Fairness Witness-findingDual networks Protected attributes: Race, Age, Sex
FQ Count20
12
Unfairness Witness FindingAdult Census Race--
12
Unfairness Witness FindingBank Marketing Age--
8
Fairness Witness-findingDual networks (Protected attributes: Age, Sex)
FQ Score248
5
Unfairness Witness FindingGerman Credit Sex--
5
Showing 5 of 5 rows

Other info

Follow for update