Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A Validation Strategy for Deep Learning Models: Evaluating and Enhancing Robustness

About

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations can significantly degrade performance, thereby challenging the overall reliability of the models. Traditional robustness validation typically relies on perturbed test datasets to assess and improve model performance. In our framework, however, we propose a validation approach that extracts "weak robust" samples directly from the training dataset via local robustness analysis. These samples, being the most susceptible to perturbations, serve as an early and sensitive indicator of the model's vulnerabilities. By evaluating models on these challenging training instances, we gain a more nuanced understanding of its robustness, which informs targeted performance enhancement. We demonstrate the effectiveness of our approach on models trained with CIFAR-10, CIFAR-100, and ImageNet, highlighting how robustness validation guided by weak robust samples can drive meaningful improvements in model reliability under adversarial and common corruption scenarios.

Abdul-Rauf Nuhu, Parham Kebria, Vahid Hemmati, Benjamin Lartey, Mahmoud Nabil Mahmoud, Abdollah Homaifar, Edward Tunstel• 2025

Related benchmarks

TaskDatasetResultRank
Image ClassificationImageNet-100 (val)--
250
Image ClassificationCIFAR-100 standard (test)--
195
Image ClassificationCIFAR-100-C v1 (test)--
60
Image ClassificationCIFAR-10-C v1 (test)
Classification Error8.954
37
Adversarial RobustnessCIFAR-100 adv (test)
Adversarial Error Rate22.78
9
Image ClassificationCIFAR-10 adv
Overall Error Rate4.9
9
Image ClassificationCIFAR-10 standard (test)
Error Rate5.05
9
Image ClassificationImageNet-100C (test)
mCE23.671
6
Image ClassificationImageNet-100-adv (test)
Adversarial Error22.356
6
Showing 9 of 9 rows

Other info

Follow for update