Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multimodal Benchmarking on MM-Bench 37
Loading...
71.5
Accuracy
Mipha-3B+ (Ours)
34.58
44.165
53.75
63.335
Jul 5, 2024
Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
Mipha-3B+ (Ours)
LM=Phi-2 (2.7B), Res.=...
2024.07
71.5
Mipha-3B
LM=Phi-2 (2.7B), Res.=...
2024.07
69.7
Bunny-3B
LM=Phi-2 (2.7B), Res.=...
2024.07
68.6
LLaVA-1.5+ (Ours)
LM=Vicuna(7B), Res.=33...
2024.07
67.6
LAF-7B
LM=Vicuna (7B), Res.=3...
2024.07
67.3
TinyLLaVA
LM=Phi-2 (2.7B), Res.=...
2024.07
66.9
Imp-v1
LM=Phi-2 (2.7B), Res.=...
2024.07
66.5
mPLUG-Owl2
LM=LLAMA (7B), Res.=44...
2024.07
64.5
LLaVA-1.5
LM=Vicuna (7B), Res.=3...
2024.07
64.3
Mobile VLM-v2-3B
LM=M-LLaMA (2.7B), Res...
2024.07
63.2
Qwen-VL-Chat
LM=Qwen (7B), Res.=448...
2024.07
60.6
LLaVA-Phi
LM=Phi-2 (2.7B), Res.=...
2024.07
59.8
Mobile VLM-3B
LM=M-LLaMA (2.7B), Res...
2024.07
59.6
Shikra
LM=Vicuna (13B), Res.=...
2024.07
58.8
Mobile VLM-v2-1.7B
LM=M-LLaMA (1.4B), Res...
2024.07
57.7
IDEFICS-80B
LM=LLaMA (65B), Res.=2...
2024.07
54.5
Mobile VLM-1.7B
LM=M-LLaMA (1.4B), Res...
2024.07
53.2
IDEFICS-9B
LM=LLaMA (7B), Res.=22...
2024.07
48.2
InstructBLIP
LM=Vicuna (7B), Res.=2...
2024.07
36
Feedback
Search any
task
Search any
task