| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| PACS | MANO | R20.924 | 50 | 4mo ago | |
| MNIST, USPS, SVHN, COCO, PASCAL, ImageNet source-target transfers | MetaEvaluator | MAE3.58 | 42 | 2mo ago | |
| Text2SQL source-target transfers Spider BIRD WikiSQL SParC CoSQL SynSQL-2.5M | MetaEvaluator | MAE3.41 | 42 | 2mo ago | |
| Nonliving-26 | COTT | MAE0.0583 | 38 | 1mo ago | |
| Nonliving-26 Subpopulation Shift | COT | R20.982 | 36 | 4mo ago | |
| Living-17 Subpopulation Shift | MANO | R20.98 | 36 | 4mo ago | |
| Entity-30 Subpopulation Shift | MANO | R20.991 | 36 | 4mo ago | |
| Entity-13 Subpopulation Shift | MANO | R20.993 | 36 | 4mo ago | |
| living-17 | COT | MAE1.373 | 27 | 1mo ago | |
| Entity-30 | MANO | MAE0.83 | 27 | 4mo ago | |
| Entity-13 | MANO | MAE0.674 | 27 | 4mo ago | |
| DomainNet | ConfScore | MAE3.375 | 27 | 4mo ago | |
| Office-Home | COT | MAE0.602 | 27 | 4mo ago | |
| ImageNet | MANO | MAE0.695 | 27 | 4mo ago | |
| TinyImageNet | MANO | MAE0.612 | 27 | 4mo ago | |
| CIFAR-100 | COT | MAE0.355 | 27 | 4mo ago | |
| CIFAR-10 | COT | MAE0.355 | 27 | 4mo ago | |
| Entity-30 | ConfScore | R20.968 | 14 | 4mo ago | |
| Entity-13 | MANO | R20.958 | 14 | 4mo ago | |
| Office-Home | MANO | R20.953 | 14 | 4mo ago | |
| CIFAR 100 | R20.993 | 14 | 4mo ago | ||
| CIFAR 10 | ATC | R20.991 | 14 | 4mo ago | |
| E30-N | FRAP | MAE (%)5.54 | 11 | 1mo ago | |
| E30-S | COTT | MAE (%)2.3 | 11 | 1mo ago | |
| E13-N | COTT | MAE (%)5.76 | 11 | 1mo ago |
