Visual Mathematical Reasoning on MathVista (testmini)
67.7Accuracy
Claude 3.5 Sonnet
Updated 3d ago
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2024.12 | 67.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 67.5 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 66.1 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 65.4 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 65.4 | 69.14 | 51.44 | 75.81 | 66.46 | 64.25 | 54.45 | 67.42 | 53.56 | 27.03 | 60.42 | 68.03 | 77.74 | |
2024.12 | 65.2 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 64.5 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 64.5 | 68.03 | 56.73 | 72.04 | 67.09 | 58.1 | 59.43 | 62.61 | 58.16 | 29.73 | 50.69 | 67.21 | 75.75 | |
2024.12 | 63.9 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 63.8 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 63.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 63.2 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 62.3 | 70.63 | 48.08 | 69.89 | 63.92 | 56.98 | 51.6 | 60.34 | 50.63 | 10.81 | 51.39 | 60.66 | 79.07 | |
2024.12 | 61.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 60.2 | 66.54 | 53.37 | 63.44 | 61.39 | 54.19 | 54.8 | 55.24 | 54.39 | 13.51 | 43.75 | 57.38 | 74.09 | |
2025.06 | 58.6 | 63.57 | 48.08 | 62.9 | 61.39 | 56.42 | 50.89 | 55.81 | 49.37 | 21.62 | 45.83 | 60.66 | 70.43 | |
2024.12 | 58.3 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 58.2 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 58 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 57.7 | 67.66 | 44.71 | 59.68 | 58.86 | 54.75 | 48.75 | 54.96 | 46.03 | 13.51 | 43.06 | 56.56 | 75.42 | |
2024.12 | 57.3 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 55.7 | 60.59 | 48.56 | 60.75 | 56.96 | 50.28 | 49.11 | 52.69 | 46.03 | 16.22 | 34.03 | 59.84 | 67.44 | |
2024.12 | 55.5 | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.06 | 54.6 | 63.57 | 40.87 | 56.99 | 62.03 | 48.04 | 45.91 | 50.42 | 42.68 | 18.92 | 40.28 | 59.02 | 70.43 | |
2024.12 | 53.2 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 51.5 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 49.3 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 49 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 48 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 42.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 36.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 27.7 | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.12 | 25.6 | - | - | - | - | - | - | - | - | - | - | - | - |