| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| 8 Vision | Absolute Score93.8 | 65 | 2mo ago | ||
| 8 classification datasets (Cars, DTD, EuroSAT, GTSRB, MNIST, RESISC45, SUN397, SVHN) (test) | ATT-FT+OrthoReg | Absolute Accuracy90.41 | 39 | 1mo ago | |
| Task Arithmetic Benchmark (test) | Linear. FT | Avg Absolute Accuracy88.5 | 12 | 5mo ago | |
| 14-Vision | DELTA | Absolute Score85.7 | 7 | 2mo ago | |
| 6NLI base (test) | Absolute Accuracy85.9 | 7 | 5mo ago |
