Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Models

About

Unsupervised meta-learning approaches rely on synthetic meta-tasks that are created using techniques such as random selection, clustering and/or augmentation. Unfortunately, clustering and augmentation are domain-dependent, and thus they require either manual tweaking or expensive learning. In this work, we describe an approach that generates meta-tasks using generative models. A critical component is a novel approach of sampling from the latent space that generates objects grouped into synthetic classes forming the training and validation data of a meta-task. We find that the proposed approach, LAtent Space Interpolation Unsupervised Meta-learning (LASIUM), outperforms or is competitive with current unsupervised learning baselines on few-shot classification tasks on the most widely used benchmark datasets. In addition, the approach promises to be applicable without manual tweaking over a wider range of domains than previous approaches.

Siavash Khodadadeh, Sharare Zehtabian, Saeed Vahidian, Weijia Wang, Bill Lin, Ladislau B\"ol\"oni• 2020

Related benchmarks

TaskDatasetResultRank
5-way ClassificationminiImageNet (test)
Accuracy69.13
231
Few-shot classificationMini-Imagenet (test)--
113
Few-shot Image ClassificationminiImageNet (test)
Accuracy69.13
111
Few-shot classificationOmniglot (test)
Accuracy95.29
109
5-way 5-shot ClassificationOmniglot (test)
Accuracy95.29
49
Face RecognitionCelebA (test)
Top-1 Acc78.13
39
5-way identity recognitionCelebA (test)
Accuracy66.98
24
5-way 1-shot ClassificationOmniglot
Accuracy83.26
23
2-way 5-shot classificationCelebA attributes (downstream)
Accuracy74.79
18
Showing 9 of 9 rows

Other info

Follow for update