Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal Understanding on MMMU 1.0 (test)
Loading...
50.6
MMMU Score
FP16 Baseline
30.112
35.431
40.75
46.069
Dec 27, 2024
MMMU Score
Average Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
MMMU Score
Average Score
FP16 Baseline
Model=Qwen2-VL-7B, Bit...
2024.12
50.6
73.8
FP16 Baseline
Model=InternVL2-8B, Bi...
2024.12
48
72.5
MBQ
Model=Qwen2-VL-7B, Bit...
2024.12
47.9
71.6
MBQ
Model=Qwen2-VL-7B, Bit...
2024.12
47.2
68.4
MBQ
Model=InternVL2-8B, Bi...
2024.12
46.9
71.1
FP16 Baseline
Model=LLaVA-onevision-...
2024.12
46
67.5
MBQ
Model=InternVL2-8B, Bi...
2024.12
45.6
69.6
MBQ
Model=LLaVA-onevision-...
2024.12
42.6
63.1
MBQ
Model=LLaVA-onevision-...
2024.12
42
65.3
GPTQ
Model=LLaVA-onevision-...
2024.12
41.9
64.1
RTN
Model=LLaVA-onevision-...
2024.12
38.2
56.1
AWQ
Model=LLaVA-onevision-...
2024.12
36.6
60.6
RTN
Model=LLaVA-onevision-...
2024.12
34.7
47.1
SQ
Model=LLaVA-onevision-...
2024.12
30.9
51.1
Feedback
Search any
task
Search any
task