Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
About
The goal of few-shot learning is to learn a classifier that generalizes well even when trained with a limited number of training instances per class. The recently introduced meta-learning approaches tackle this problem by learning a generic classifier across a large number of multiclass classification tasks and generalizing the model to a new task. Yet, even with such meta-learning, the low-data problem in the novel classification task still remains. In this paper, we propose Transductive Propagation Network (TPN), a novel meta-learning framework for transductive inference that classifies the entire test set at once to alleviate the low-data problem. Specifically, we propose to learn to propagate labels from labeled instances to unlabeled test instances, by learning a graph construction module that exploits the manifold structure in the data. TPN jointly learns both the parameters of feature embedding and the graph construction in an end-to-end manner. We validate TPN on multiple benchmark datasets, on which it largely outperforms existing few-shot learning approaches and achieves the state-of-the-art results.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Few-shot classification | tieredImageNet (test) | Accuracy73.3 | 282 | |
| Few-shot Image Classification | Mini-Imagenet (test) | Accuracy75.65 | 235 | |
| 5-way Classification | miniImageNet (test) | Accuracy69.9 | 231 | |
| Image Classification | MiniImagenet | Accuracy66.42 | 206 | |
| Few-shot classification | Mini-ImageNet | 1-shot Acc59.5 | 175 | |
| 5-way Few-shot Classification | MiniImagenet | Accuracy (5-shot)75.65 | 150 | |
| 5-way Few-shot Classification | Mini-Imagenet (test) | 1-shot Accuracy59.46 | 141 | |
| Few-shot classification | miniImageNet standard (test) | 5-way 1-shot Acc59.46 | 138 | |
| 5-way Image Classification | tieredImageNet 5-way (test) | 1-shot Acc59.91 | 117 | |
| Few-shot Image Classification | miniImageNet (test) | -- | 111 |