Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationEMNIST (test)
Accuracy94.63
238
Image ClassificationEMNIST Balanced
Accuracy91.06
103
Image ClassificationEMNIST
Accuracy98.9
90
Backdoor DetectionEMNIST
TPR100
49
Image ClassificationEMNIST Dir(0.1) (test)
Test Accuracy96.55
41
Image ClassificationEMNIST-L (test)
Top-1 Acc94.81
36
Image ClassificationEMNIST Balanced (test)
Accuracy91.06
34
Image ClassificationEMNIST Letters 4 (test)
Accuracy67.42
33
Image ClassificationEMNIST Dir(0.5) (test)
Test Accuracy91.82
31
ClusteringE-MNIST
Accuracy95.5
25
Image ClassificationM(EMNIST-20, F-EMNIST)
Accuracy97.12
22
Federated Backdoor DefenseEMNIST
ASR10
21
Image ReconstructionEMNIST (test)
MSE0.001
17
Clusteringemnist
ARI41.2
17
Task-incremental LearningEMNIST 20 tasks
Average Accuracy88.5
15
Image ClassificationEMNIST Letters (test)
Accuracy95.96
15
Handwritten Character ClassificationEMNIST-Letters (test)
Accuracy95.88
15
Image ClassificationEMNIST (Shards)
RES1
14
Image ClassificationEMNIST Dirichlet
RES100
14
Image ClassificationEMNIST (IID)
RES100
14
Image ClassificationEMNIST Letters
Clean Accuracy81.4
14
Streaming Image ClassificationEMNIST label-permuted 5M interactions 2000 tasks (streaming)
Average Online Accuracy80.7
14
Image ClassificationEMNIST Private Task Finetuned (test)
Accuracy85
14
Image ClassificationEMNIST Public Task Finetuned (test)
Accuracy88.5
14
Out-of-Distribution DetectionEMNIST (test)
AUROC0.917
14
Showing 25 of 105 rows