Partner-Assisted Learning for Few-Shot Image Classification
About
Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning methods, how to train a feature extractor is still a challenge. In this paper, we focus on the design of training strategy to obtain an elemental representation such that the prototype of each novel class can be estimated from a few labeled samples. We propose a two-stage training scheme, Partner-Assisted Learning (PAL), which first trains a partner encoder to model pair-wise similarities and extract features serving as soft-anchors, and then trains a main encoder by aligning its outputs with soft-anchors while attempting to maximize classification performance. Two alignment constraints from logit-level and feature-level are designed individually. For each few-shot task, we perform prototype classification. Our method consistently outperforms the state-of-the-art method on four benchmarks. Detailed ablation studies of PAL are provided to justify the selection of each component involved in training.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Few-shot Image Classification | Mini-Imagenet (test) | -- | 235 | |
| 5-way Few-shot Classification | Mini-Imagenet (test) | 1-shot Accuracy69.37 | 141 | |
| Few-shot Image Classification | tieredImageNet (test) | -- | 86 | |
| 5-way 5-shot Classification | miniImageNet (test) | Accuracy84.4 | 56 | |
| 5-way Few-shot Classification | tieredImageNet | -- | 49 | |
| 5-way 1-shot Classification | Mini-Imagenet (test) | Accuracy69.37 | 43 | |
| 5-way Few-shot Classification | tiered-ImageNet (test) | 1-shot Acc72.25 | 33 | |
| Few-shot Image Classification | FC100 5-way 5-shot (test) | Accuracy64 | 28 | |
| Few-shot Image Classification | FC100 5-way 1-shot (test) | Average Accuracy47.2 | 28 | |
| Image Classification | tiered-ImageNet | 1-Shot Acc72.25 | 25 |