Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

iNaturalist

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationiNaturalist 2018
Top-1 Accuracy94.6
291
Out-of-Distribution DetectioniNaturalist
AUROC99.9
219
Image ClassificationiNaturalist 2018 (test)
Top-1 Accuracy84.5
207
Image ClassificationiNaturalist 18
Overall Accuracy87
125
Image ClassificationiNaturalist 2018 (val)
Top-1 Accuracy84.1
116
Image ClassificationiNaturalist OOD (test)
Avg Minority-Group Acc99.06
104
Category-level RetrievaliNaturalist 2018
mAP98.6
98
Image ClassificationiNaturalist 2019
Top-1 Acc88.5
98
Long-Tailed Image ClassificationiNaturalist 2018
Accuracy85.2
82
Image ClassificationiNaturalist 2021
Top-1 Accuracy87.3
70
Far Out-of-Distribution DetectioniNaturalist
FPR955.76
64
Image ClassificationiNaturalist
Accuracy73.8
63
Long-tail Image ClassificationiNaturalist 2018 (test)
Accuracy (Few)88.3
59
OOD DetectioniNaturalist
AUROC99.71
52
Out-of-Distribution DetectioniNaturalist (test)
AUROC98.15
44
OOD DetectioniNaturalist OOD
AUROC99.16
40
Long-tailed Visual RecognitioniNaturalist 2018 (test)
Accuracy75.3
39
Image ClassificationiNaturalist 2018 (natural world distribution)
Acc (Total)0.756
39
Image ClassificationiNaturalist 2017 (val)
Top-1 Accuracy72.2
35
Image ClassificationiNaturalist 2018 (All)
Top-1 Accuracy74.6
33
Far OOD detectioniNaturalist (test)
AUROC98.49
32
Image ClassificationiNaturalist (test)
Accuracy81.2
28
Fine-grained ClassificationiNaturalist-19
Top-1 Error Rate35.33
24
Image RetrievaliNaturalist (test)
Recall@173.6
24
Image ClassificationiNaturalist 2017 (test)
Top-1 Accuracy71.7
24
Showing 25 of 103 rows