Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FEMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationFEMNIST (test)
Accuracy97.31
104
Image ClassificationFEMNIST
Accuracy92.56
50
Image ClassificationFEMNIST (LEAF) (test)
Accuracy82.45
39
Machine UnlearningFEMNIST natural partition (test)
MIA Accuracy76.3
24
Personalized Federated Learning UnlearningFEMNIST (natural partition)
PPS100
20
Image ClassificationFEMNIST C=10 original (test)
Accuracy82.4
17
Character RecognitionFEMNIST (train)
Accuracy72.72
14
Image ClassificationFEMNIST (test)
Mean Accuracy70.6
14
Image ClassificationFEMNIST (non-iid)
Accuracy84
13
Gradient InversionFEMNIST
PSNR24.1797
12
Multi-class classificationFEMNIST realistic non-IID LEAF benchmark (test)
Top-1 Acc85.2
11
Federated UnlearningFEMNIST
Average Unlearning Time (s)398
10
Image ClassificationFEMNIST LEAF
Accuracy80.61
10
Image ClassificationFEMNIST Practical
Mean Accuracy100
9
Image ClassificationFEMNIST 10 new writers (test)
Overall Accuracy88.18
9
Federated UnlearningFEMNIST
MIA Accuracy53.6
8
Federated Image ClassificationFEMNIST non-i.i.d.
Test Error14.76
8
Federated Image ClassificationFEMNIST i.i.d.
Test Error Rate14.79
8
Image ClassificationFEMNIST non-i.i.d.
Test Error Rate14.76
8
Image ClassificationFEMNIST (i.i.d.)
Test Error14.79
8
Character RecognitionFEMNIST (test)
Accuracy65.04
7
Image ClassificationFEMNIST (test)
Accuracy (alpha=0.1)80.6
7
Handwritten character recognitionFEMNIST 7 (test)
Avg Accuracy79.9
7
Backdoor DefenseFEMNIST
Clean Accuracy73.5
6
Image ClassificationFEMNIST Dir-0.1 (test)
Accuracy86.3
6
Showing 25 of 36 rows