Multimodal Reasoning on MMMU-Pro
55Std-10 Score
Claude-3.5-Sonnet
Updated 2d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.12 | 55 | 48 | 51.5 | |
2024.12 | 54 | 49.7 | 51.9 | |
2024.12 | 51.4 | 45.9 | 48.6 | |
2024.12 | 49.4 | 44.4 | 46.9 | |
2024.12 | 49.2 | 43.3 | 46.2 | |
2024.12 | 48 | 44 | 46 | |
2024.12 | 41.9 | 38 | 40 | |
2024.12 | 41.6 | 32.6 | 37.1 | |
2024.12 | 38.2 | 30.4 | 34.3 | |
2024.12 | 38 | 24 | 31 | |
2024.12 | 36.4 | 29 | 32.7 | |
2024.12 | 36.3 | 32.1 | 34.2 | |
2024.12 | 35.9 | 14.1 | 25 | |
2024.12 | 34.1 | 27 | 30.5 | |
2024.12 | 32.8 | 27.1 | 30 | |
2024.12 | 32.5 | 25.4 | 29 | |
2024.12 | 30.2 | 24.2 | 27.2 | |
2024.12 | 29.5 | 19.9 | 24.7 | |
2024.12 | 28.2 | 21.3 | 24.7 | |
2024.12 | 27.3 | 20.1 | 23.7 | |
2024.12 | 26.3 | 13.1 | 19.7 | |
2024.12 | 25.3 | 17.2 | 21.2 | |
2024.12 | 23.3 | 15.5 | 19.4 | |
2024.12 | 21.6 | 14.9 | 18.2 | |
2024.12 | 16 | 13.6 | 14.8 |