Learning Placeholders for Open-Set Recognition
About
Traditional classifiers are deployed under closed-set setting, with both training and test classes belong to the same set. However, real-world applications probably face the input of unknown categories, and the model will recognize them as known ones. Under such circumstances, open-set recognition is proposed to maintain classification performance on known classes and reject unknowns. The closed-set models make overconfident predictions over familiar known class instances, so that calibration and thresholding across categories become essential issues when extending to an open-set environment. To this end, we proposed to learn PlaceholdeRs for Open-SEt Recognition (Proser), which prepares for the unknown classes by allocating placeholders for both data and classifier. In detail, learning data placeholders tries to anticipate open-set class data, thus transforms closed-set training into open-set training. Besides, to learn the invariant information between target and non-target classes, we reserve classifier placeholders as the class-specific boundary between known and unknown. The proposed Proser efficiently generates novel class by manifold mixup, and adaptively sets the value of reserved open-set classifier during training. Experiments on various datasets validate the effectiveness of our proposed method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Open Set Recognition | CIFAR10 | AUROC0.96 | 76 | |
| Open-Set Object Detection | Cityscapes -> Foggy Cityscapes (val) | mAP55.7 | 72 | |
| Open Set Recognition | SVHN | AUROC0.943 | 51 | |
| Open Set Recognition | TinyImageNet | AUROC69.3 | 51 | |
| Open Set Recognition | CIFAR+50 | AUROC95.3 | 50 | |
| Node Classification | DBLP | -- | 31 | |
| 3D Object Retrieval | OS-ABO core | mAP50.33 | 26 | |
| 3D Object Retrieval | OS-MN40 core | mAP49 | 26 | |
| 3D Object Retrieval | OS-NTU core | mAP39.47 | 26 | |
| 3D Object Retrieval | OS-ESB core | mAP48.69 | 26 |