Multimodal Multilingual Reasoning on MMMB
86.8English Accuracy
Qwen2-VL-72B
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.12 | 86.8 | 85.3 | 85.2 | 84.8 | 84.2 | 85.3 | - | |
2024.12 | 86.4 | 85.1 | 84.1 | 84.3 | 82.8 | 84.9 | - | |
2024.12 | 86.3 | 85.6 | 85.1 | 84.8 | 83.1 | 85.4 | - | |
2024.12 | 86.2 | 83.8 | 81.6 | 73.3 | 73.7 | 82.8 | - | |
2025.09 | 86 | 84.8 | 83 | 82.7 | 80.3 | 83.6 | - | |
2024.12 | 85.3 | 84.1 | 81.1 | 70.3 | 74.2 | 81.4 | - | |
2024.12 | 85.3 | 85.1 | 82.8 | 82.8 | 83 | 83.7 | - | |
2025.09 | 85.2 | 84.5 | 83.1 | 81.8 | 79.6 | 84 | - | |
2025.09 | 85.1 | 83.1 | 82.5 | 81.6 | 76.2 | 83.4 | - | |
2025.09 | 85 | 83.6 | 82.1 | 83.3 | 76.4 | 83.2 | - | |
2025.09 | 84.9 | 83 | 81.4 | 79.6 | 77.4 | 83.1 | - | |
2025.09 | 84.9 | 84.3 | 82.8 | 82.3 | 79 | 83.3 | - | |
2025.09 | 84.4 | 83 | 81.8 | 81.2 | 75.8 | 83 | - | |
2024.12 | 84.3 | 83.1 | 78.6 | 69.3 | 71.5 | 79.5 | - | |
2024.12 | 83.9 | 82.4 | 81.2 | 79 | 74.7 | 82.4 | - | |
2025.09 | 83.9 | 82.4 | 81.2 | 79 | 74.7 | 82.4 | - | |
2024.12 | 83.8 | 81.7 | 78 | 68.8 | 69.3 | 76.3 | - | |
2024.12 | 83.7 | 81 | 79.7 | 76 | 70.5 | 79.9 | - | |
2024.12 | 83.4 | 81.5 | 76.1 | 66.3 | 69.2 | 75.7 | - | |
2025.09 | 83.2 | 81.1 | 80.6 | 80.5 | 77.3 | 82.2 | - | |
2024.12 | 82.6 | 80.8 | 76.3 | 65.2 | 68.6 | 74 | - | |
2024.12 | 82 | 76.1 | 75.6 | 54.3 | 51.2 | 67.4 | - | |
2025.09 | 81.9 | 78.3 | 75.4 | 68.6 | 62.9 | 74.6 | - | |
2024.12 | 81.4 | 74.4 | 58.2 | 48.3 | 46.4 | 53.2 | - | |
2025.09 | 81.2 | 81 | 74.8 | 71 | 65.6 | 75.2 | - | |
2025.09 | 80.2 | 77.7 | 75.9 | 68.5 | 69.1 | 76.3 | - | |
2025.09 | 80.1 | 80 | 79.6 | 76.5 | 75 | 79.9 | - | |
2024.12 | 79.4 | 71.6 | 54 | 43.5 | 46.4 | 48.1 | - | |
2025.09 | 79 | 78.2 | 75.9 | 73.3 | 67.7 | 76.3 | - | |
2024.12 | 78.8 | 70.2 | 61.5 | 55 | 45.3 | 61.1 | - | |
2024.12 | 78.3 | 74.2 | 72.6 | 68.3 | 61.8 | 72.8 | - | |
2025.09 | 78.3 | 74.2 | 72.6 | 68.3 | 61.8 | 72.8 | - | |
2024.12 | 75 | 74.2 | 71.5 | 73.5 | 69 | 73.1 | - | |
2024.12 | 75 | 71.9 | 70.6 | 69.9 | 69.6 | 72.7 | - | |
2024.12 | 73.2 | 67.4 | 55.5 | 53.5 | 43.8 | 55.2 | - | |
2025.09 | 72.6 | 65.9 | 64.4 | 49.7 | 49 | 67.5 | - | |
2025.09 | 69.2 | 62.8 | 61.5 | 47.2 | 46.9 | 64.3 | - | |
2024.12 | 67.3 | 61 | 59.7 | 45.8 | 45.4 | 62.6 | - | |
2025.09 | 66 | 58.1 | 46.3 | 38.8 | 37.6 | 48.5 | - |