Multimodal Understanding on CQA, DVQA, TVQA, IVQA, OCRB, MMB, MMMU, MVista, AI2D, MMS, MMV (test)
85.8MMB
EMMA
Updated 3mo ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.12 | 85.8 | 88 | 95.9 | 79.5 | 77.7 | 89 | 62.5 | 75.8 | 83.9 | 64.8 | 73 | 79.6 | |
2025.12 | 85.6 | 87.8 | 95.5 | 79 | 77.4 | 88.4 | 62 | 75.4 | 83.6 | 64.2 | 72.5 | 79.2 | |
2025.12 | 85 | - | - | - | - | - | 55.3 | 73.1 | - | - | 67.2 | - | |
2025.12 | 84.2 | 87.1 | 94.4 | - | 76.1 | 80 | 52.7 | 67.9 | 83.6 | 64.9 | - | - | |
2025.12 | 83.6 | 82.8 | 95.2 | 80.9 | 79.9 | 88.1 | 67.4 | 73.7 | 83.9 | 69.8 | 66.2 | 79.2 | |
2025.12 | 83.5 | - | - | - | - | - | 58.6 | - | - | - | 67.1 | - | |
2025.12 | 83.5 | - | - | - | - | - | 58.6 | - | - | - | 66.6 | - | |
2025.12 | 81.4 | 86.3 | 91.9 | 77.8 | 77.5 | 81.7 | 60 | 68.4 | 82 | 64 | 76.1 | 77 | |
2025.12 | 79.3 | - | - | - | - | - | 48.9 | - | 78.6 | 56.6 | - | - | |
2025.12 | 79.2 | - | - | - | - | - | 41 | - | - | - | 50 | - | |
2025.12 | 79.1 | - | - | - | - | - | 53.1 | - | - | - | 61.8 | - | |
2025.12 | 75.1 | 66.7 | 76 | - | 45.5 | 66.9 | 38.2 | - | 71.4 | - | 37 | - | |
2025.12 | 75 | - | - | - | - | - | 44.2 | - | - | - | - | - | |
2025.12 | 72.1 | - | - | - | - | - | 39.7 | 51.3 | 69.8 | 49.6 | - | - | |
2025.12 | 58.5 | 68.6 | 76.3 | 64.7 | 43.8 | 68.7 | 31.6 | - | 70 | - | 37.2 | - | |
2025.12 | - | - | - | 60.8 | - | - | - | - | - | - | 33.5 | - |