Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Visual Question Answering (Perception + Reasoning) on MathVista, MMStar, and MMVet
Loading...
46.9
MathVista Score
LATTE
30.468
34.734
39
43.266
Dec 7, 2024
MathVista Score
MMStar Score
MMVet Score
Aggregate Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
MathVista Score
MMStar Score
MMVet Score
Aggregate Score
LATTE
Language / Vision=Qwen...
2024.12
46.9
50.8
50.9
51.2
Vanilla IT
Language / Vision=Qwen...
2024.12
42.4
50.1
39.3
43.9
LATTE
Language / Vision=LLaM...
2024.12
38.9
45.1
50
44.7
LATTE
Language / Vision=LLaM...
2024.12
36.6
40.8
45.2
40.8
Vanilla IT
Language / Vision=LLaM...
2024.12
36.2
40.7
29.7
35.5
LATTE
Language / Vision=LLaM...
2024.12
34.9
44.6
45.2
41.6
Vanilla IT
Language / Vision=LLaM...
2024.12
33.1
36.7
28.9
32.9
Vanilla IT
Language / Vision=LLaM...
2024.12
31.1
40.5
33
34.9
Feedback
Search any
task
Search any
task