Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Models
About
Unsupervised meta-learning approaches rely on synthetic meta-tasks that are created using techniques such as random selection, clustering and/or augmentation. Unfortunately, clustering and augmentation are domain-dependent, and thus they require either manual tweaking or expensive learning. In this work, we describe an approach that generates meta-tasks using generative models. A critical component is a novel approach of sampling from the latent space that generates objects grouped into synthetic classes forming the training and validation data of a meta-task. We find that the proposed approach, LAtent Space Interpolation Unsupervised Meta-learning (LASIUM), outperforms or is competitive with current unsupervised learning baselines on few-shot classification tasks on the most widely used benchmark datasets. In addition, the approach promises to be applicable without manual tweaking over a wider range of domains than previous approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 5-way Classification | miniImageNet (test) | Accuracy69.13 | 231 | |
| Few-shot classification | Mini-Imagenet (test) | -- | 113 | |
| Few-shot Image Classification | miniImageNet (test) | Accuracy69.13 | 111 | |
| Few-shot classification | Omniglot (test) | Accuracy95.29 | 109 | |
| 5-way 5-shot Classification | Omniglot (test) | Accuracy95.29 | 49 | |
| Face Recognition | CelebA (test) | Top-1 Acc78.13 | 39 | |
| 5-way identity recognition | CelebA (test) | Accuracy66.98 | 24 | |
| 5-way 1-shot Classification | Omniglot | Accuracy83.26 | 23 | |
| 2-way 5-shot classification | CelebA attributes (downstream) | Accuracy74.79 | 18 |