Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal Task Accuracy on OSWorld
Loading...
41.49
Multimodal Task Accuracy
KIVI
10.9556
18.8828
26.81
34.7372
May 16, 2026
Multimodal Task Accuracy
Updated 15d ago
Evaluation Results
Method
Method
Links
Multimodal Task Accuracy
KIVI
Model=Qwen3-VL-32B-Thi...
2026.05
41.49
TriAxialKV INT4
Model=Qwen3-VL-32B-Thi...
2026.05
41.43
TriAxialKV Mixed
Model=Qwen3-VL-32B-Thi...
2026.05
40.59
SGLang FP4
Model=Qwen3-VL-32B-Thi...
2026.05
40.54
SGLang BF16
Model=Qwen3-VL-32B-Thi...
2026.05
39.2
TriAxialKV Mixed
Model=Qwen3-VL-8B-Thin...
2026.05
35.78
KIVI
Model=Qwen3-VL-8B-Thin...
2026.05
34.61
SGLang BF16
Model=Qwen3-VL-8B-Thin...
2026.05
34.02
TriAxialKV INT4
Model=Qwen3-VL-8B-Thin...
2026.05
33.92
SGLang FP4
Model=Qwen3-VL-8B-Thin...
2026.05
29.52
TriAxialKV INT4
Model=InternVL3.5-38B
2026.05
13.11
TriAxialKV Mixed
Model=InternVL3.5-38B
2026.05
12.77
KIVI
Model=InternVL3.5-38B
2026.05
12.26
SGLang BF16
Model=InternVL3.5-38B
2026.05
12.22
SGLang FP4
Model=InternVL3.5-38B
2026.05
12.13
Feedback
Search any
task
Search any
task