Learning Placeholders for Open-Set Recognition
About
Traditional classifiers are deployed under closed-set setting, with both training and test classes belong to the same set. However, real-world applications probably face the input of unknown categories, and the model will recognize them as known ones. Under such circumstances, open-set recognition is proposed to maintain classification performance on known classes and reject unknowns. The closed-set models make overconfident predictions over familiar known class instances, so that calibration and thresholding across categories become essential issues when extending to an open-set environment. To this end, we proposed to learn PlaceholdeRs for Open-SEt Recognition (Proser), which prepares for the unknown classes by allocating placeholders for both data and classifier. In detail, learning data placeholders tries to anticipate open-set class data, thus transforms closed-set training into open-set training. Besides, to learn the invariant information between target and non-target classes, we reserve classifier placeholders as the class-specific boundary between known and unknown. The proposed Proser efficiently generates novel class by manifold mixup, and adaptively sets the value of reserved open-set classifier during training. Experiments on various datasets validate the effectiveness of our proposed method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Open Set Recognition | CIFAR10 | AUROC0.96 | 76 | |
| Open Set Recognition | SVHN | AUROC0.943 | 51 | |
| Open Set Recognition | TinyImageNet | AUROC69.3 | 51 | |
| Open Set Recognition | CIFAR+50 | AUROC95.3 | 50 | |
| Open Set Recognition | CIFAR+10 | AUROC0.96 | 24 | |
| Node Classification | Citeseer | ID Accuracy71.25 | 24 | |
| Few-Shot Open-Set Recognition | mini-ImageNet 1-shot | AUROC68.93 | 20 | |
| Few-Shot Open-Set Recognition | tiered-ImageNet 1-shot | AUROC70.07 | 20 | |
| Few-Shot Open-Set Recognition | tiered-ImageNet 5-shot | AUROC75.84 | 20 | |
| Few-Shot Open-Set Recognition | mini-ImageNet 5-shot | Accuracy80.08 | 20 |