Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FEMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationFEMNIST (test)
Accuracy97.31
83
Image ClassificationFEMNIST (LEAF) (test)
Accuracy82.45
39
Image ClassificationFEMNIST
Accuracy81.1
15
Image ClassificationFEMNIST C=10 original (test)
Accuracy82.02
13
Image ClassificationFEMNIST (non-iid)
Accuracy84
13
Multi-class classificationFEMNIST realistic non-IID LEAF benchmark (test)
Top-1 Acc85.2
11
Image ClassificationFEMNIST LEAF
Accuracy80.61
10
Image ClassificationFEMNIST 10 new writers (test)
Overall Accuracy88.18
9
Federated Image ClassificationFEMNIST non-i.i.d.
Test Error14.76
8
Federated Image ClassificationFEMNIST i.i.d.
Test Error Rate14.79
8
Image ClassificationFEMNIST non-i.i.d.
Test Error Rate14.76
8
Image ClassificationFEMNIST (i.i.d.)
Test Error14.79
8
Handwritten character recognitionFEMNIST 7 (test)
Avg Accuracy79.9
7
Personalized Federated LearningFEMNIST (test)
Top 10% Most Samples Accuracy76.24
5
Malicious Client DetectionFEMNIST
Accuracy79.37
4
Federated Learning ClassificationFEMNIST FedAvg 0.8235 (test)
Accuracy81.45
4
Handwriting image classificationFEMNIST LEAF (test)
Personalization Accuracy71.84
3
Federated Image ClassificationFEMNIST unseen clients (test)
Test Accuracy79.1
3
Image ClassificationFEMNIST LEAF (non-i.i.d.)
Accuracy-
0
Showing 19 of 19 rows