Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
OpenBook Question Answering on OBQA
Loading...
0.855
Accuracy
Qwen2.5-Omni-7B
0.2258
0.38915
0.5525
0.71585
Oct 15, 2025
Accuracy
Gap
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Gap
Qwen2.5-Omni-7B
System Type=End-to-end...
2025.10
0.855
3.5
ASR + Qwen2.5-7B
System Type=Cascaded t...
2025.10
0.84
5
ASR + Qwen2.5-3B
System Type=Cascaded t...
2025.10
0.769
4.9
SALAD-3B
Training Stage=Stage II
2025.10
0.767
5.1
SALAD-7B
Training Stage=Stage II
2025.10
0.751
13.9
SALAD-7B
Training Stage=Stage I
2025.10
0.697
19.3
SALAD-3B
Training Stage=Stage I
2025.10
0.655
16.3
GLM-4-Voice-9B
System Type=End-to-end...
2025.10
0.576
30.1
DiVA-Llama3.1-8B
System Type=End-to-end...
2025.10
0.409
42.4
Qwen2-Audio-7B
System Type=End-to-end...
2025.10
0.396
37.1
Random
2025.10
0.25
-
Feedback
Search any
task
Search any
task