Vision-related Reasoning and Perception on MMBench (test)
76.8Avg Score
Idefics2
Updated 2d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.05 | 76.8 | - | - | - | - | - | - | |
2024.05 | 76.7 | - | - | - | - | - | - | |
2023.09 | 74.4 | 50.6 | 82 | 76.1 | 79.3 | 59.2 | 81.7 | |
2024.05 | 73.2 | - | - | - | - | - | - | |
2024.05 | 72.3 | - | - | - | - | - | - | |
2024.05 | 70 | - | - | - | - | - | - | |
2023.09 | 66 | 43.4 | 76 | 62.1 | 68.6 | 55.9 | 73 | |
2023.09 | 65.2 | 44.3 | 77.9 | 64.8 | 66.5 | 53.6 | 70.6 | |
2023.09 | 62.6 | 41 | 74.3 | 55.9 | 61.6 | 58.7 | 69.2 | |
2023.09 | 61.8 | 40.5 | 74.3 | 47.9 | 66.3 | 46.2 | 72.8 | |
2023.09 | 60.2 | 33.5 | 69.6 | 53.1 | 61.8 | 50.4 | 71.7 | |
2023.09 | 59.5 | 32.4 | 72.6 | 49.3 | 62.3 | 52.2 | 67.7 | |
2023.09 | 48.3 | 22.2 | 63.3 | 39.4 | 46.8 | 36.4 | 60.6 | |
2023.09 | 38.9 | 7.4 | 45.3 | 19.2 | 45 | 32 | 54 | |
2023.09 | 36.2 | 15.9 | 53.6 | 28.6 | 41.8 | 20 | 40.4 | |
2023.09 | 33.9 | 21.6 | 47.4 | 22.5 | 33 | 24.4 | 41.1 | |
2023.09 | 33.5 | 11.4 | 48.8 | 27.7 | 35.8 | 17.6 | 41.5 | |
2023.09 | 23 | 13.6 | 32.9 | 8.9 | 28.8 | 11.2 | 28.3 |