Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationEMNIST (test)
Accuracy94.63
234
Image ClassificationEMNIST Balanced
Accuracy91.06
103
Image ClassificationEMNIST
Accuracy98.9
82
Image ClassificationEMNIST-L (test)
Top-1 Acc94.81
36
Image ClassificationEMNIST Balanced (test)
Accuracy91.06
34
Image ClassificationEMNIST Letters 4 (test)
Accuracy67.42
33
Image ClassificationEMNIST Dir(0.1) (test)
Test Accuracy96.55
28
ClusteringE-MNIST
Accuracy95.5
25
Image ClassificationM(EMNIST-20, F-EMNIST)
Accuracy97.12
22
Image ClassificationEMNIST Dir(0.5) (test)
Test Accuracy91.82
18
Clusteringemnist
ARI41.2
17
Image ClassificationEMNIST Letters (test)
Accuracy95.96
15
Handwritten Character ClassificationEMNIST-Letters (test)
Accuracy95.88
15
Image ClassificationEMNIST Private Task Finetuned (test)
Accuracy85
14
Image ClassificationEMNIST Public Task Finetuned (test)
Accuracy88.5
14
Out-of-Distribution DetectionEMNIST (test)
AUROC0.917
14
Adversarial Reconstruction DefenseEMNIST (test)
FID (A)20.8
13
Image ReconstructionEMNIST (test)
MSE0.302
12
Image ClassificationEMNIST (Non-IID (4-Class partition))
Accuracy86.88
12
Lossless Image CompressionEMNIST ByClass (test)
Bits Per Pixel (BPP)2.3
12
Handwritten Character ClassificationEMNIST-Digits (test)
Accuracy99.82
12
Conformal PredictionEMNIST ByClass (test)
Mean Prediction Set Size1.98
12
Conformal PredictionEMNIST
Avg Prediction Set Size2.19
12
Conformal PredictionEMNIST 10 different calib. (test)
Mean Prediction Set Size2.42
12
ClassificationEMNIST (test)
Mean Prediction Set Size1.98
12
Showing 25 of 85 rows