| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Winoground | Text Agreement Score89.5 | 26 | 3d ago | ||
| Foil | PAPSP-S | AURC0.245 | 23 | 4d ago | |
| VL-Checklist | PAPSP-S | AURC0.258 | 23 | 4d ago | |
| What’sUp | PAPSP-S | AURC26.2 | 23 | 4d ago | |
| Sugar-Crepe | LamRA | Accuracy93.5 | 19 | 4d ago | |
| SugarCrepe | ReCoVERR | AURC16.7 | 17 | 4d ago | |
| CC-Neg | U-MARVEL+ | Accuracy86.1 | 17 | 4d ago | |
| EQ-SD EQBEN | FIBER + EQSIM | Text Score90.81 | 14 | 3d ago | |
| EQ-KUBRIC EQBEN | FIBER + EQSIM | Text Score51.9 | 14 | 3d ago | |
| EQ-AG EQBEN | FIBER | Text Score32.49 | 14 | 3d ago | |
| EQ-GEBC (EQBEN) | FIBER | Text Score25.19 | 14 | 3d ago | |
| YouCook2 EQBEN | BLIP | Text Score59.22 | 14 | 3d ago | |
| MSCOCO HN | OpenCLIP (ViT-B-32) | I-to-T Score49.07 | 11 | 4d ago | |
| Winoground 1.0 (full) | MTurk Human | Text Agreement Score89.5 | 5 | 3d ago | |
| Winoground clean | syn-BLIP | Text Agreement Score52.63 | 4 | 3d ago | |
| SugarCREPE sampled balanced | VisReP | Accuracy58.7 | 3 | 4d ago | |
| Winoground (full) | VisReP | Accuracy52.7 | 3 | 4d ago |
