Accuracy Estimation

Benchmarks

Dataset Name	SOTA Method	Metric
PACS	MANO	R20.924	50	3mo ago
MNIST, USPS, SVHN, COCO, PASCAL, ImageNet source-target transfers	MetaEvaluator	MAE3.58	42	9d ago
Text2SQL source-target transfers Spider BIRD WikiSQL SParC CoSQL SynSQL-2.5M	MetaEvaluator	MAE3.41	42	9d ago
Nonliving-26 Subpopulation Shift	COT	R20.982	36	3mo ago
Living-17 Subpopulation Shift	MANO	R20.98	36	3mo ago
Entity-30 Subpopulation Shift	MANO	R20.991	36	3mo ago
Entity-13 Subpopulation Shift	MANO	R20.993	36	3mo ago
Nonliving-26	MANO	MAE1.01	27	3mo ago
living-17	COT	MAE1.373	27	3mo ago
Entity-30	MANO	MAE0.83	27	3mo ago
Entity-13	MANO	MAE0.674	27	3mo ago
DomainNet	ConfScore	MAE3.375	27	3mo ago
Office-Home	COT	MAE0.602	27	3mo ago
ImageNet	MANO	MAE0.695	27	3mo ago
TinyImageNet	MANO	MAE0.612	27	3mo ago
CIFAR-100	COT	MAE0.355	27	3mo ago
CIFAR-10	COT	MAE0.355	27	3mo ago
Entity-30	ConfScore	R20.968	14	3mo ago
Entity-13	MANO	R20.958	14	3mo ago
Office-Home	MANO	R20.953	14	3mo ago
CIFAR 100		R20.993	14	3mo ago
CIFAR 10	ATC	R20.991	14	3mo ago
Amazon Review	TRM	Absolute Estimation Error0.018	10	3mo ago
CIFAR10-C	TRM	Absolute Estimation Error2.2	10	3mo ago
Office-31	TRM	Absolute Estimation Error0.018	10	3mo ago

Showing 25 of 38 rows