MNIST

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Classification	MNIST (test)	Accuracy99.35	882
Image Classification	MNIST	Accuracy99.87	395
Image Classification	MNIST	Accuracy99.94	263
Image Classification	MNIST (test)	Test Accuracy99.67	126
Clustering	MNIST (test)	NMI0.97	122
Backdoor Certification	MNIST (test)	AER1.81	112
Graph Classification	MNIST (test)	Accuracy98.8	110
Image Classification	MNIST rotated (test)	Test Error (%)0.59	105
Image Generation	MNIST Binary (test)	FID4.69	98
Clustering	MNIST (full)	Accuracy98.7	98
Graph classification	MNIST	Accuracy99.2	95
Digit Classification	MNIST (test)	Error Rate0.21	94
Clustering	MNIST	NMI0.978	92
Federated Learning Classification	MNIST FedAvg 0.962 (test)	Accuracy96.2	88
Anomaly Detection	MNIST	AUC99.35	87
Image Classification	MNIST (test)	Accuracy99.6	81
Pixel-by-pixel Image Classification	Permuted Sequential MNIST (pMNIST) (test)	Accuracy98.76	79
Image Classification	MNIST	Clean Accuracy99.64	71
Anomaly Detection	MNIST (test)	AUC99.6	65
Digit Classification	MNIST -> USPS (test)	Accuracy98.5	65
Image Classification	MNIST -> USPS (test)	Accuracy99.5	64
Image Classification	permuted MNIST (pMNIST) (test)	Accuracy97.87	63
Image Classification	MNIST NN (test)	Communication Rounds16	62
Image Classification	Permuted MNIST T=784 (test)	Accuracy97	62
Image Classification	MNIST (test)	Accuracy99.52	61

Showing 25 of 822 rows

...