PACS

Benchmarks

Task Name	Dataset Name	SOTA Result
Domain Generalization	PACS	Accuracy99.92	323
Image Classification	PACS	Overall Average Accuracy97.99	299
Domain Generalization	PACS (test)	Average Accuracy99.7	281
Image Classification	PACS (test)	Average Accuracy97.51	279
Domain Generalization	PACS (leave-one-domain-out)	Art Accuracy97.85	152
Image Classification	PACS	Accuracy98.47	130
Object Recognition	PACS (leave-one-domain-out)	Acc (Art painting)90.35	112
Image Classification	PACS v1 (test)	Average Accuracy87.83	92
Multi-class classification	PACS (test)	Accuracy (Art Painting)82.73	76
Image Classification	PACS (out-of-domain)	Overall Accuracy96.3	63
Accuracy Estimation	PACS	R20.924	50
Single-domain Generalization	PACS	Accuracy (P)88.09	44
Image Classification Calibration	PACS Photo	ECE0.48	39
Image Classification	PACS (leave-one-domain-out)	P Accuracy97.92	39
Multi-source Domain Adaptation	PACS	Acc (Art Painting)98.77	39
Multi-source Domain Generalization	PACS	Accuracy97	37
Domain Generalization	PACS OOD (test)	Average Accuracy97.3	31
Image Classification Calibration	PACS Sketch	ECE1.54	30
Image Classification Calibration	PACS Cartoon	ECE2.04	30
Image Classification Calibration	PACS Art	ECE2.12	30
Single-source Domain Generalization	PACS (test)	Average Domain Transfer Accuracy72.2	30
Domain Generalization	PACS DomainBed (test)	Accuracy97.2	29
Out-of-Distribution Detection	PACS Open-Set DTD Food101 Caltech101	DTD AUC99.6	28
Object Recognition	PACS	Performance (P)99.2	27
Domain Generalization	PACS 23 (test)	Acc (Photo)97.05	26

Showing 25 of 99 rows