DPGN: Distribution Propagation Graph Network for Few-shot Learning
About
Most graph-network-based meta-learning approaches model instance-level relation of examples. We extend this idea further to explicitly model the distribution-level relation of one example to all other examples in a 1-vs-N manner. We propose a novel approach named distribution propagation graph network (DPGN) for few-shot learning. It conveys both the distribution-level relations and instance-level relations in each few-shot learning task. To combine the distribution-level relations and instance-level relations for all examples, we construct a dual complete graph network which consists of a point graph and a distribution graph with each node standing for an example. Equipped with dual graph architecture, DPGN propagates label information from labeled examples to unlabeled examples within several update generations. In extensive experiments on few-shot learning benchmarks, DPGN outperforms state-of-the-art results by a large margin in 5% $\sim$ 12% under supervised setting and 7% $\sim$ 13% under semi-supervised setting. Code will be released.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Few-shot classification | tieredImageNet (test) | -- | 282 | |
| Few-shot Image Classification | Mini-Imagenet (test) | -- | 235 | |
| 5-way Classification | miniImageNet (test) | -- | 231 | |
| Few-shot classification | Mini-ImageNet | 1-shot Acc67.77 | 175 | |
| Few-shot classification | miniImageNet standard (test) | 5-way 1-shot Acc67.77 | 138 | |
| Few-shot Image Classification | tieredImageNet (test) | -- | 86 | |
| 5-way Few-shot Image Classification | CIFAR FS (test) | 1-shot Acc77.9 | 63 | |
| 5-way Image Classification | CIFAR FS (test) | -- | 60 | |
| Few-shot classification | CIFAR-FS | Accuracy (5-way 1-shot)77.9 | 58 | |
| Few-shot classification | CUB-200-2011 (test) | 5-way 1-shot Acc76.05 | 56 |