Federated Image Classification

Benchmarks

Dataset Name	SOTA Method	Metric
CIFAR100 (test)	FairGrad*	Accuracy70.78	144	1mo ago
CIFAR-100 and CIFAR-100-C brightness (test)	FedRoD+FOOGD	Accuracy (In-Distribution)0.7788	33	4mo ago
Fashion-MNIST (test)		Accuracy82.4	20	5mo ago
CIFAR10 (test)	FedGELA	GA74.07	13	1mo ago
OrganCMNIST (test)	FedKPer	Global Accuracy66	12	2mo ago
OrganSMNIST (test)	FedKPer	Global Accuracy51.7	12	2mo ago
BloodMNIST (test)	FedKPer	Average Global Accuracy64.5	12	2mo ago
Federated EMNIST (test)	Spectral Sentinel	Accuracy78.4	12	5mo ago
SVHN (test)	FedGELA	PA98.52	12	4mo ago
CIFAR-10 Dirichlet alpha=0.5 (test)	FedCoE	Local Accuracy77.27	11	2mo ago
Fed-ISIC 2019	FedGELA	PA79.27	11	4mo ago
PACS	FedDAP	Accuracy (Photo)90.43	10	3mo ago
Office-Caltech	FedHPro	Accuracy (Caltech)64.61	9	2mo ago
Digits	FedHPro	Accuracy (MNIST)98.52	9	2mo ago
CIFAR-100 IID (test)		CBA MTA71.87	9	2mo ago
CIFAR-10 IID (test)	FedAvg	CBA MTA92.04	9	2mo ago
SVHN (test)	Proposed	Rounds1	8	1mo ago
TinyImageNet 95% target accuracy (test)	Proposed	Communication Rounds1	8	1mo ago
CIFAR-10 (i.i.d.)	FedEx	Test Error20.82	8	4mo ago
FEMNIST non-i.i.d.	FedEx	Test Error14.76	8	4mo ago
FEMNIST i.i.d.	Successive Halving	Test Error Rate14.79	8	4mo ago
CIFAR-100 Dirichlet alpha=0.5 (test)	FedPrism	Global Accuracy14.47	7	4mo ago
FMNIST Dirichlet alpha=0.5 (test)	FedPrism	Global Accuracy88.12	7	4mo ago
SVHN Dirichlet alpha=0.5 (test)	FedPrism	Global Accuracy86.94	7	4mo ago
MNIST non-IID, α=0.1 (test)	FedAvg-M	Test Accuracy95.51	6	2mo ago

Showing 25 of 31 rows