Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RNNP: A Robust Few-Shot Learning Approach

About

Learning from a few examples is an important practical aspect of training classifiers. Various works have examined this aspect quite well. However, all existing approaches assume that the few examples provided are always correctly labeled. This is a strong assumption, especially if one considers the current techniques for labeling using crowd-based labeling services. We address this issue by proposing a novel robust few-shot learning approach. Our method relies on generating robust prototypes from a set of few examples. Specifically, our method refines the class prototypes by producing hybrid features from the support examples of each class. The refined prototypes help to classify the query images better. Our method can replace the evaluation phase of any few-shot learning method that uses a nearest neighbor prototype-based evaluation procedure to make them robust. We evaluate our method on standard mini-ImageNet and tiered-ImageNet datasets. We perform experiments with various label corruption rates in the support examples of the few-shot classes. We obtain significant improvement over widely used few-shot learning methods that suffer significant performance degeneration in the presence of label noise. We finally provide extensive ablation experiments to validate our method.

Pratik Mazumder, Pravendra Singh, Vinay P. Namboodiri• 2020

Related benchmarks

TaskDatasetResultRank
Few-shot classificationtieredImageNet (test)
Accuracy71.36
282
Few-shot classificationMini-Imagenet (test)
Accuracy68.38
113
Few-shot classificationMiniImageNet 5-way 10-shot (test)
Accuracy68.89
69
Few-shot Image ClassificationMiniImageNet 5-way 3-shot (test)
Accuracy62.55
46
Few-shot Image ClassificationMiniImageNet 5-way 10-shot (test)
Accuracy (0% noise)73.47
46
5-Shot 5-Way ClassificationminiImageNet (test)
Accuracy47.88
36
5-way 5-shot Classificationtiered-ImageNet (test)
Accuracy50.91
32
5-way 3-shot Image ClassificationMiniImageNet 0% noise 54 (test)
Accuracy62.57
23
5-way 3-shot Image ClassificationMiniImageNet 33.3% symmetric label swap noise 54 (test)
Accuracy48.76
23
5-way 5-shot ClassificationtieredImageNet
Accuracy (0% Noise)71.28
16
Showing 10 of 11 rows

Other info

Follow for update