Our new X account is live! Follow @wizwand_team for updates

Real-world Multimodal Reasoning on RealWorldQA

75.4Accuracy

GPT-4o

Updated 3d ago

Evaluation Results

Method	Links
GPT-4o 2024.09		75.4
GPT-4o 2024.09		75.4
EMOVA 2024.09		71
MM1.5-30B 2024.09		69
Grok-1.5V 2024.04		68.7
Gemini Pro 1.5 2024.09		68.7
Cambrian-34B 2024.09		67.8
Gemini Pro 1.5 2024.04		67.5
InternVL 1.2 2024.04		67.5
EMOVA 2024.09		67.5
VITA 2024.09		66.8
InternVL 1.5 2024.04		66
Gemini-1.5-Pro 2024.09		64.1
EMOVA 2024.09		62.6
Baichuan-Omni 2024.09		62.6
MM1.5-7B 2024.09		62.5
GPT-4V 2024.04		61.4
GPT-4V 2024.09		61.4
MM1.5-3B-MoE 2024.09		60.7
BLIP-3 2024.09		60.5
Phi-3-Vision-4B 2024.09		59.4
MM1-30B 2024.09		59.4
VITA 2024.09		59
MM1.5-1B-MoE 2024.09		57.8
InternVL2-2B 2024.09		57.4
Dynamic-LLaVA-7B† 2024.12		57
MM1.5-3B 2024.09		56.9
GPT-4V 2024.09		56.5
MiniCPM-V 2.0-3B 2024.09		55.8
MM1-3B 2024.09		55.8
MM1-7B 2024.09		55.7
LLaVAOne Vision-0.5B 2024.09		55.6
IVTP 2024.12		54.6
LLaVA-1.5-7B 2024.12		53.7
LLaVA-FastV 2024.12		53.7
MM1.5-1B 2024.09		53.3
Claude-3 Sonnet 2024.04		51.9
MM1-1B 2024.09		51.2
Claude-3 Opus 2024.04		49.8
LLaVA-1.5-7B+H2O 2024.12		42.3