Image-Text Matching on Winoground
89.5Text Agreement Score
MTurk Human
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.01 | 89.5 | 88.5 | 85.5 | - | |
2024.01 | 64.25 | 52.5 | 50.75 | - | |
2024.01 | 58.5 | 49.5 | 44.5 | - | |
2024.01 | 58.25 | 55.25 | 41.5 | - | |
2024.01 | 54.5 | 42.5 | 37.75 | - | |
2023.03 | 51.49 | 31.49 | 27.5 | - | |
2023.03 | 51.24 | 26.49 | 23 | - | |
2024.01 | 51 | 48 | 47.5 | - | |
2024.01 | 47.5 | 47.25 | 39 | - | |
2024.01 | 46.75 | 45 | 36.75 | - | |
2024.01 | 46.5 | 40.75 | 37.75 | - | |
2023.03 | 46.25 | 25.75 | 22.24 | - | |
2024.01 | 45 | 25 | 23.75 | - | |
2023.03 | 44.99 | 22.75 | 18.75 | - | |
2023.03 | 43.5 | 20.75 | 14.75 | - | |
2023.03 | 43.25 | 19.75 | 16.75 | - | |
2024.01 | 42.5 | 27.5 | 20 | - | |
2024.01 | 40 | 32.5 | 27.75 | - | |
2023.03 | 39.25 | 15.75 | 11.99 | - | |
2024.01 | 39 | 41.25 | 33.25 | - | |
2023.03 | 38 | 18.25 | 14.5 | - | |
2024.01 | 30.75 | 26 | 25 | - | |
2023.03 | 30 | 10.75 | 8.25 | - | |
2023.03 | 28.5 | 9.5 | 7.25 | - | |
2024.01 | 25 | 25 | 16.67 | - | |
2024.01 | 22.5 | 33 | 20.75 | - | |
2026.01 | - | - | - | 22.9 | |
2026.01 | - | - | - | 25.2 | |
2026.01 | - | - | - | 25.8 | |
2026.01 | - | - | - | 22.8 | |
2026.01 | - | - | - | 20.8 | |
2026.01 | - | - | - | 19.6 | |
2026.01 | - | - | - | 20.9 | |
2026.01 | - | - | - | 20.3 | |
2026.01 | - | - | - | 19.6 | |
2026.01 | - | - | - | 24.6 | |
2026.01 | - | - | - | 24.1 | |
2026.01 | - | - | - | 24 | |
2026.01 | - | - | - | 24.2 | |
2026.01 | - | - | - | 25.8 | |
2026.01 | - | - | - | 22.8 | |
2026.01 | - | - | - | 20.8 | |
2026.01 | - | - | - | 19.6 |