Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

OwMatch: Conditional Self-Labeling with Consistency for Open-World Semi-Supervised Learning

About

Semi-supervised learning (SSL) offers a robust framework for harnessing the potential of unannotated data. Traditionally, SSL mandates that all classes possess labeled instances. However, the emergence of open-world SSL (OwSSL) introduces a more practical challenge, wherein unlabeled data may encompass samples from unseen classes. This scenario leads to misclassification of unseen classes as known ones, consequently undermining classification accuracy. To overcome this challenge, this study revisits two methodologies from self-supervised and semi-supervised learning, self-labeling and consistency, tailoring them to address the OwSSL problem. Specifically, we propose an effective framework called OwMatch, combining conditional self-labeling and open-world hierarchical thresholding. Theoretically, we analyze the estimation of class distribution on unlabeled data through rigorous statistical analysis, thus demonstrating that OwMatch can ensure the unbiasedness of the self-label assignment estimator with reliability. Comprehensive empirical analyses demonstrate that our method yields substantial performance enhancements across both known and unknown classes in comparison to previous studies. Code is available at https://github.com/niusj03/OwMatch.

Shengjie Niu, Lifan Lin, Jian Huang, Chao Wang• 2024

Related benchmarks

TaskDatasetResultRank
Generalized Category DiscoveryImageNet-100
All Accuracy85.5
138
Novel Class DiscoveryCIFAR-100
ACC (Seen)0.699
19
Image ClassificationCIFAR-100
Seen Class Accuracy80.1
14
Image ClassificationCIFAR-10
Accuracy (Seen)96.5
14
Generalized Novel Class DiscoveryTiny ImageNet (test)
Seen Accuracy68.8
13
Novel Class DiscoveryCIFAR-10 (test)
Seen Acc94.4
11
Deepfake AttributionOW-DFA-40 Protocol-3
All ACC84.3
10
Deepfake AttributionOW-DFA-40 Protocol-1
All Accuracy74.1
10
Deepfake AttributionOW-DFA-40 Protocol-2
All Accuracy72.6
10
Novel Class DiscoveryImageNet-100 (test)
Seen Accuracy87.8
5
Showing 10 of 10 rows

Other info

Code

Follow for update