Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deep multi-class learning from label proportions

About

We propose a learning algorithm capable of learning from label proportions instead of direct data labels. In this scenario, our data are arranged into various bags of a certain size, and only the proportions of each label within a given bag are known. This is a common situation in cases where per-data labeling is lengthy, but a more general label is easily accessible. Several approaches have been proposed to learn in this setting with linear models in the multiclass setting, or with nonlinear models in the binary classification setting. Here we investigate the more general nonlinear multiclass setting, and compare two differentiable loss functions to train end-to-end deep neural networks from bags with label proportions. We illustrate the relevance of our methods on an image classification benchmark, and demonstrate the possibility to learn accurate image classifiers from bags of images.

Gabriel Dulac-Arnold, Neil Zeghidour, Marco Cuturi, Lucas Beyer, Jean-Philippe Vert• 2019

Related benchmarks

TaskDatasetResultRank
Image ClassificationSVHN (test)
Accuracy96.75
401
Image ClassificationSVHN
Accuracy96.75
395
Image ClassificationCIFAR-100
Accuracy72.74
302
Image ClassificationCIFAR10 (test)
Test Accuracy78.37
284
Image ClassificationEMNIST (test)
Accuracy93.19
234
Image ClassificationMiniImagenet
Accuracy67.02
206
Image ClassificationSVHN (test)
Accuracy31.23
199
Image ClassificationFashionMNIST
Accuracy94.25
171
Image ClassificationMini-Imagenet (test)
Top-1 Accuracy67.02
91
Image ClassificationFashion MNIST (test)
Accuracy (%)94.25
55
Showing 10 of 11 rows

Other info

Follow for update