Transferable Contrastive Network for Generalized Zero-Shot Learning
About
Zero-shot learning (ZSL) is a challenging problem that aims to recognize the target categories without seen data, where semantic information is leveraged to transfer knowledge from some source classes. Although ZSL has made great progress in recent years, most existing approaches are easy to overfit the sources classes in generalized zero-shot learning (GZSL) task, which indicates that they learn little knowledge about target classes. To tackle such problem, we propose a novel Transferable Contrastive Network (TCN) that explicitly transfers knowledge from the source classes to the target classes. It automatically contrasts one image with different classes to judge whether they are consistent or not. By exploiting the class similarities to make knowledge transfer from source images to similar target classes, our approach is more robust to recognize the target images. Experiments on five benchmark datasets show the superiority of our approach for GZSL.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Generalized Zero-Shot Learning | CUB | H Score52.3 | 250 | |
| Generalized Zero-Shot Learning | SUN | H34 | 184 | |
| Generalized Zero-Shot Learning | AWA2 | S Score65.8 | 165 | |
| Zero-shot Learning | CUB | Top-1 Accuracy59.5 | 144 | |
| Zero-shot Learning | SUN | Top-1 Accuracy61.5 | 114 | |
| Zero-shot Learning | AWA2 | Top-1 Accuracy0.712 | 95 | |
| Image Classification | CUB | Unseen Top-1 Acc52.6 | 89 | |
| Image Classification | SUN | Harmonic Mean Top-1 Accuracy34 | 86 | |
| Zero-shot Learning | SUN (unseen) | Top-1 Accuracy (%)61.5 | 50 | |
| Generalized Zero-Shot Learning | AWA1 | S Score76.5 | 49 |