Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Transferable Contrastive Network for Generalized Zero-Shot Learning

About

Zero-shot learning (ZSL) is a challenging problem that aims to recognize the target categories without seen data, where semantic information is leveraged to transfer knowledge from some source classes. Although ZSL has made great progress in recent years, most existing approaches are easy to overfit the sources classes in generalized zero-shot learning (GZSL) task, which indicates that they learn little knowledge about target classes. To tackle such problem, we propose a novel Transferable Contrastive Network (TCN) that explicitly transfers knowledge from the source classes to the target classes. It automatically contrasts one image with different classes to judge whether they are consistent or not. By exploiting the class similarities to make knowledge transfer from source images to similar target classes, our approach is more robust to recognize the target images. Experiments on five benchmark datasets show the superiority of our approach for GZSL.

Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen• 2019

Related benchmarks

TaskDatasetResultRank
Generalized Zero-Shot LearningCUB
H Score52.3
250
Generalized Zero-Shot LearningSUN
H34
184
Generalized Zero-Shot LearningAWA2
S Score65.8
165
Zero-shot LearningCUB
Top-1 Accuracy59.5
144
Zero-shot LearningSUN
Top-1 Accuracy61.5
114
Zero-shot LearningAWA2
Top-1 Accuracy0.712
95
Image ClassificationCUB
Unseen Top-1 Acc52.6
89
Image ClassificationSUN
Harmonic Mean Top-1 Accuracy34
86
Zero-shot LearningSUN (unseen)
Top-1 Accuracy (%)61.5
50
Generalized Zero-Shot LearningAWA1
S Score76.5
49
Showing 10 of 23 rows

Other info

Code

Follow for update