| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Winoground 1.0 (test) | Human | Text Score89.5 | 23 | 2mo ago | |
| SugarCrepe++ | Slipform | Accuracy66.24 | 20 | 3mo ago | |
| ARO | CE-CLIP+ | Accuracy0.804 | 14 | 4mo ago | |
| ARO Benchmark Visual Genome Flickr30k MS-COCO (test) | CapPa | VG Attribution89.3 | 11 | 4mo ago | |
| What's-up | CLIP-FT | Relation Score44.2 | 10 | 1mo ago | |
| Winoground standard (test) | GPT-4o | Text Score75.5 | 7 | 4mo ago | |
| Winoground (test) | JAM (Spread) | Text Score61.3 | 7 | 2mo ago | |
| ARO (test) | syn-CLIP | VG-Rel71.4 | 4 | 4mo ago | |
| Winoground clean (no-tag) | CyCLIP | Text Score32.16 | 2 | 4mo ago |
