Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multi-task Knowledge on MMSU
Loading...
67.1
Accuracy
ASR + Qwen2.5-7B
23.316
34.683
46.05
57.417
Oct 15, 2025
Accuracy
Gap
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Gap
ASR + Qwen2.5-7B
System Type=Cascaded t...
2025.10
67.1
3.7
Qwen2.5-Omni-7B
System Type=End-to-end...
2025.10
61
-9.8
ASR + Qwen2.5-3B
System Type=Cascaded t...
2025.10
58.1
3.8
SALAD-7B
Training Stage=Stage II
2025.10
57.5
13.3
SALAD-7B
Training Stage=Stage I
2025.10
55.3
15.5
SALAD-3B
Training Stage=Stage II
2025.10
52.5
9.4
SALAD-3B
Training Stage=Stage I
2025.10
47.3
14.6
GLM-4-Voice-9B
System Type=End-to-end...
2025.10
38.6
27.6
DiVA-Llama3.1-8B
System Type=End-to-end...
2025.10
36.1
25.8
Qwen2-Audio-7B
System Type=End-to-end...
2025.10
29.5
18.7
Random
2025.10
25
-
Feedback
Search any
task
Search any
task