Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

IN

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image GenerationSub-IN 256x256 (test)
FID20.03
36
Image ClassificationIN-100
Accuracy85.4
24
Image ClassificationIN-100-Text
Accuracy80.6
18
Image ClassificationIN32-100
Accuracy69.8
18
Image ClassificationTiny-IN
Accuracy62.98
12
Image GenerationSub-IN 256x256 (test val)
FID27.45
12
Accuracy EstimationIN200-N
MAE (%)3.5
11
Accuracy EstimationIN200-S
MAE (%)3.02
11
Accuracy EstimationIN-N
MAE (%)1.15
11
Accuracy EstimationIN-S
MAE (%)2.14
11
Zero-shot Image ClassificationIN-100 Text
OCA (Zero-shot)80.6
10
Bitext MiningIN22 GenBitextMining
F18.85
10
OoD DetectionIN 200
AUC90.51
8
Image ClassificationIN-sketch
Top-1 Acc26.9
8
Interactive Question AnsweringIN3
Ask Rate100
7
Membership Inference AttackTiny-IN
ASR90.31
6
Tabular RegressionIN Insurance (test)
MLE0.784
5
Synthetic Tabular Data GenerationIN
DCR6.1
2
Showing 18 of 18 rows