Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adversarial Bayesian Augmentation for Single-Source Domain Generalization

About

Generalizing to unseen image domains is a challenging problem primarily due to the lack of diverse training data, inaccessible target data, and the large domain shift that may exist in many real-world settings. As such data augmentation is a critical component of domain generalization methods that seek to address this problem. We present Adversarial Bayesian Augmentation (ABA), a novel algorithm that learns to generate image augmentations in the challenging single-source domain generalization setting. ABA draws on the strengths of adversarial learning and Bayesian neural networks to guide the generation of diverse data augmentations -- these synthesized image domains aid the classifier in generalizing to unseen domains. We demonstrate the strength of ABA on several types of domain shift including style shift, subpopulation shift, and shift in the medical imaging setting. ABA outperforms all previous state-of-the-art methods, including pre-specified augmentations, pixel-based and convolutional-based augmentations.

Sheng Cheng, Tejas Gokhale, Yezhou Yang• 2023

Related benchmarks

TaskDatasetResultRank
Image ClassificationPACS
Accuracy66.02
100
Single-source Domain GeneralizationPACS (test)
Average Domain Transfer Accuracy66.36
26
Abdominal Organ SegmentationAbdominal MRI to CT
DSC (LIV)87.63
26
Abdominal Organ SegmentationAbdominal CT to MRI
DSC (Liver)78.54
26
Image ClassificationDigits
Average Accuracy74.76
23
siRNA perturbation classificationRxRx1 out-of-distribution wilds (test)
Performance (HEPG2)12.4
22
Single-source Domain GeneralizationDIGITS (test)
Acc (MNIST-M)80.94
19
Genetic perturbation classificationRxRx1-wilds in-distribution (test)
HEPG2 Performance9.1
11
Hyperspectral Image ClassificationHouston cross-scene (Houston13 to Houston18)
Overall Accuracy (OA)52.68
8
Hyperspectral Image ClassificationPavia cross-scene (PaviaU to PaviaC)
Overall Accuracy57.87
8
Showing 10 of 11 rows

Other info

Code

Follow for update