Few-Shot Learning with Embedded Class Models and Shot-Free Meta Training
About
We propose a method for learning embeddings for few-shot learning that is suitable for use with any number of ways and any number of shots (shot-free). Rather than fixing the class prototypes to be the Euclidean average of sample embeddings, we allow them to live in a higher-dimensional space (embedded class models) and learn the prototypes along with the model parameters. The class representation function is defined implicitly, which allows us to deal with a variable number of shots per each class with a simple constant-size architecture. The class embedding encompasses metric learning, that facilitates adding new classes without crowding the class representation space. Despite being general and not tuned to the benchmark, our approach achieves state-of-the-art performance on the standard few-shot benchmark datasets.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Few-shot classification | tieredImageNet (test) | -- | 282 | |
| Few-shot Image Classification | Mini-Imagenet (test) | -- | 235 | |
| Few-shot classification | Mini-ImageNet | 1-shot Acc59.04 | 175 | |
| Few-shot classification | miniImageNet standard (test) | 5-way 1-shot Acc59.04 | 138 | |
| Few-shot Image Classification | tieredImageNet | Accuracy0.8259 | 90 | |
| 5-way Few-shot Image Classification | CIFAR FS (test) | 1-shot Acc69.2 | 63 | |
| 5-way Image Classification | CIFAR FS (test) | -- | 60 | |
| Few-shot classification | CIFAR-FS | Accuracy (5-way 1-shot)69.2 | 58 | |
| Few-shot Image Classification | CIFAR FS (test) | Accuracy84.7 | 46 | |
| Image Classification | miniImageNet 5-way 1-shot (meta-test) | Accuracy59.04 | 41 |