Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

About

Modern deep neural networks can achieve high accuracy when the training distribution and test distribution are identically distributed, but this assumption is frequently violated in practice. When the train and test distributions are mismatched, accuracy can plummet. Currently there are few techniques that improve robustness to unforeseen data shifts encountered during deployment. In this work, we propose a technique to improve the robustness and uncertainty estimates of image classifiers. We propose AugMix, a data processing technique that is simple to implement, adds limited computational overhead, and helps models withstand unforeseen corruptions. AugMix significantly improves robustness and uncertainty measures on challenging image classification benchmarks, closing the gap between previous methods and the best possible performance in some cases by more than half.

Dan Hendrycks, Norman Mu, Ekin D. Cubuk, Barret Zoph, Justin Gilmer, Balaji Lakshminarayanan• 2019

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-100 (test)--
3518
Image ClassificationCIFAR-10 (test)
Accuracy95.82
3381
Image ClassificationImageNet-1k (val)
Top-1 Accuracy76.75
1469
Image ClassificationImageNet (val)--
1206
Image ClassificationImageNet 1k (test)
Top-1 Accuracy77.5
848
Image ClassificationCIFAR-100 (val)--
776
Image ClassificationCIFAR-100
Accuracy81.18
691
Image ClassificationCIFAR-10--
564
Image ClassificationTinyImageNet (val)--
289
Image ClassificationPACS (test)
Average Accuracy40.8
271
Showing 10 of 83 rows
...

Other info

Code

Follow for update