Prototypical Networks for Few-shot Learning
About
We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks learn a metric space in which classification can be performed by computing distances to prototype representations of each class. Compared to recent approaches for few-shot learning, they reflect a simpler inductive bias that is beneficial in this limited-data regime, and achieve excellent results. We provide an analysis showing that some simple design decisions can yield substantial improvements over recent approaches involving complicated architectural choices and meta-learning. We further extend prototypical networks to zero-shot learning and achieve state-of-the-art results on the CU-Birds dataset.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | Fashion MNIST (test) | Accuracy84.15 | 633 | |
| Node Classification | Cora | Accuracy57.92 | 583 | |
| Named Entity Recognition | CoNLL 2003 (test) | -- | 556 | |
| Node Classification | Citeseer | Accuracy53.75 | 503 | |
| Classification | Cars | Accuracy47.98 | 492 | |
| Image Classification | CUB | Accuracy65.03 | 331 | |
| Node Classification | Cora-ML | Accuracy76.94 | 326 | |
| Node Classification | Ogbn-arxiv | Accuracy47.31 | 304 | |
| Few-shot classification | tieredImageNet (test) | Accuracy84.03 | 282 | |
| Class-incremental learning | CIFAR-100 | Averaged Incremental Accuracy41.7 | 281 |