Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multimodal Understanding on MMMU 1.0 (test)
Loading...
50.6
MMMU Score
FP16 Baseline
30.112
35.431
40.75
46.069
Dec 27, 2024
MMMU Score
Average Score
Updated 4d ago
Evaluation Results
Method
Method
Links
MMMU Score
Average Score
FP16 Baseline
Model=Qwen2-VL-7B, Bit...
2024.12
50.6
73.8
FP16 Baseline
Model=InternVL2-8B, Bi...
2024.12
48
72.5
MBQ
Model=Qwen2-VL-7B, Bit...
2024.12
47.9
71.6
MBQ
Model=Qwen2-VL-7B, Bit...
2024.12
47.2
68.4
MBQ
Model=InternVL2-8B, Bi...
2024.12
46.9
71.1
FP16 Baseline
Model=LLaVA-onevision-...
2024.12
46
67.5
MBQ
Model=InternVL2-8B, Bi...
2024.12
45.6
69.6
MBQ
Model=LLaVA-onevision-...
2024.12
42.6
63.1
MBQ
Model=LLaVA-onevision-...
2024.12
42
65.3
GPTQ
Model=LLaVA-onevision-...
2024.12
41.9
64.1
RTN
Model=LLaVA-onevision-...
2024.12
38.2
56.1
AWQ
Model=LLaVA-onevision-...
2024.12
36.6
60.6
RTN
Model=LLaVA-onevision-...
2024.12
34.7
47.1
SQ
Model=LLaVA-onevision-...
2024.12
30.9
51.1
Feedback
Search any
task
Search any
task