Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deep Subdomain Adaptation Network for Image Classification

About

For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. Previous deep domain adaptation methods mainly learn a global domain shift, i.e., align the global source and target distributions without considering the relationships between two subdomains within the same category of different domains, leading to unsatisfying transfer learning performance without capturing the fine-grained information. Recently, more and more researchers pay attention to Subdomain Adaptation which focuses on accurately aligning the distributions of the relevant subdomains. However, most of them are adversarial methods which contain several loss functions and converge slowly. Based on this, we present Deep Subdomain Adaptation Network (DSAN) which learns a transfer network by aligning the relevant subdomain distributions of domain-specific layer activations across different domains based on a local maximum mean discrepancy (LMMD). Our DSAN is very simple but effective which does not need adversarial training and converges fast. The adaptation can be achieved easily with most feed-forward network models by extending them with LMMD loss, which can be trained efficiently via back-propagation. Experiments demonstrate that DSAN can achieve remarkable results on both object recognition tasks and digit classification tasks. Our code will be available at: https://github.com/easezyc/deep-transfer-learning

Yongchun Zhu, Fuzhen Zhuang, Jindong Wang, Guolin Ke, Jingwu Chen, Jiang Bian, Hui Xiong, Qing He• 2021

Related benchmarks

TaskDatasetResultRank
Image ClassificationOffice-Home v1.0 (test)
Average Accuracy47.52
62
Image ClassificationDomainNet
Average Accuracy34.5
58
object recognitionN-Caltech101
Accuracy94.56
51
Sleep Stage ClassificationSHHS Sleep-EDF 2 (test)
Accuracy75.64
22
Sleep Stage ClassificationSleep-EDF to SHHS-1 cross-dataset
Macro F1 Score69.48
22
Sleep Stage ClassificationSHHS-2 SHHS-1 (test)
Accuracy75.8
22
Sleep Stage ClassificationSleep-EDFX from SHHS
Macro F157.17
17
Sleep Stage ClassificationSHHS1 (test)
Accuracy67.43
15
Sleep Stage ClassificationSleep-EDF SHHS-1 (test)
Accuracy83.43
11
Sleep Stage ClassificationCross-Dataset Suite (Sleep-EDF, SHHS-1, SHHS-2) Combined (test)
Average Accuracy74.07
11
Showing 10 of 14 rows

Other info

Follow for update