PACS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Classification | PACS (test) | Average Accuracy97.51 | 271 | |
| Image Classification | PACS | Overall Average Accuracy97.99 | 241 | |
| Domain Generalization | PACS | Accuracy99.92 | 231 | |
| Domain Generalization | PACS (test) | Average Accuracy97.4 | 225 | |
| Domain Generalization | PACS (leave-one-domain-out) | Art Accuracy97.85 | 152 | |
| Object Recognition | PACS (leave-one-domain-out) | Acc (Art painting)90.35 | 112 | |
| Image Classification | PACS | Accuracy98.47 | 100 | |
| Image Classification | PACS v1 (test) | Average Accuracy87.83 | 92 | |
| Multi-class classification | PACS (test) | Accuracy (Art Painting)82.73 | 76 | |
| Image Classification | PACS (out-of-domain) | Overall Accuracy96.3 | 63 | |
| Accuracy Estimation | PACS | R20.924 | 50 | |
| Image Classification | PACS (leave-one-domain-out) | P Accuracy97.92 | 32 | |
| Domain Generalization | PACS DomainBed (test) | Accuracy97.2 | 29 | |
| Single-source Domain Generalization | PACS (test) | Average Domain Transfer Accuracy71.64 | 26 | |
| Domain Generalization | PACS 23 (test) | Acc (Photo)97.05 | 26 | |
| Image Classification | PACS OOD (test) | Accuracy82.8 | 24 | |
| Image Classification | PACS ID (train) | Accuracy96.7 | 24 | |
| Image Classification | PACS TotalHeavyTail setting (test) | Overall Accuracy0.764 | 24 | |
| Image Classification | PACS GINIDG setting (test) | Accuracy (Overall)0.857 | 24 | |
| Post-deployment performance monitoring | PACS Style Shift | R20.913 | 23 | |
| Continual Learning | PACS (OOD) | AAUC54.99 | 22 | |
| Continual Learning | PACS (ID) | Average AUC (AAUC)88.4 | 22 | |
| Image Classification | PACS DomainBed suite (test) | Accuracy97.4 | 20 | |
| Multi-source Domain Generalization | PACS | Accuracy97 | 19 | |
| Open Domain Generalization | PACS | Accuracy99.53 | 19 |
Showing 25 of 72 rows