fMNIST

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Classification	FMNIST (test)	Test Accuracy88.9	230
Classification	FMNIST (test)	Accuracy99.06	152
Backdoor Attack	FMNIST	ASR100	75
Image Classification	FMNIST 0.5 (test)	Accuracy78.06	72
Classification	FMNIST	Accuracy84.28	53
Backdoor Attack in Dataset Condensation	FMNIST	CTA88.4	43
Dimensionality Reduction	FMNIST	AUC R_NX Score76.48	42
Image Classification	FMNIST	Accuracy (IID)84.842	33
Clustering	FMNIST	NMI66.35	31
Anomaly Detection	FMNIST	Avg AUROC0.956	29
Out-of-Distribution Detection	FMNIST	OOD Score97.3	26
Image Classification	FMNIST	Speedup69.24	21
Dimensionality Reduction	FMNIST	AUC RNX0.7648	21
Stealthiness Assessment	FMNIST	PSNR60.11	20
Image Classification	FMNIST	Accuracy92.54	20
KNN Classification	FMNIST	Accuracy (k=1)87.47	20
Silhouette Score Evaluation	FMNIST	Silhouette Score0.2315	20
KNN Classification	FMNIST	Accuracy (k=5)88.3	20
OOD Detection	FMNIST In-distribution: CIFAR100 (test)	AUPR (%)78.6	18
OOD Detection	FMNIST In-distribution: CIFAR10 (test)	AUPR92.5	18
Untargeted white-box adversarial attack	FMNIST original (test)	Original Error Rate0.1	16
Image Classification	FMNIST i.i.d. (test)	Accuracy75.81	14
Image Classification	FMNIST	Accuracy86.7	13
Feature Attribution	FMNIST	INFD0	13
Image Classification	FMNIST	CTA Score85.8	12

Showing 25 of 65 rows