Share your thoughts, 1 month free Claude Pro on usSee more

Real-world Visual Question Answering on MME-RealWorld-Lite (MMERW)

57Accuracy

GPT-5-0807

Updated 19d ago

Evaluation Results

Method	Links
GPT-5-0807 2025.11		57
GPT-4o-0513 2025.11		51.6
SpatialThinker-30B 2025.11		49.2
SSL4RL-7B (Mask) 2025.10		49.03
SSL4RL-7B (Hard-Contrastive) 2025.10		48.61
SpatialThinker-7B 2025.11		48.3
Qwen2.5-VL-7B + SFT 2025.11		47.4
Claude-4-Sonnet-0514 2025.11		46.9
Qwen2.5-VL-3B + Vanilla GRPO 2025.11		46.7
SpatialThinker-3B 2025.11		46.5
Qwen2.5-VL-7B + Vanilla GRPO 2025.11		46.3
Qwen3-VL-30B 2025.11		45.8
Qwen2.5-VL-7B 2025.10		45.59
Claude-3.5-Sonnet-0620 2025.11		45.2
Qwen2.5-VL 7B + NoisyGRPO 2025.10		44.6
VLAA-Thinker-7B 2025.11		44.6
Qwen2.5-VL-7B 2025.11		44.1
Qwen2.5-VL 3B + SFT 2025.10		44
Qwen2.5-VL 3B + NoisyGRPO 2025.10		44
Qwen2.5-VL 7B 2025.10		43.6
Qwen2.5-VL 7B + SFT 2025.10		43.5
Qwen2.5-VL-3B + SFT 2025.11		43
Qwen2.5-VL 7B + GRPO 2025.10		42.3
Qwen2.5-VL 3B 2025.10		42.1
Qwen2.5-VL-3B 2025.11		41.9
Qwen2.5-VL 3B + GRPO 2025.10		40.8
Position 2025.10		38.19
Jigsaw 2025.10		35.12
Rotation 2025.10		34.18
Qwen2.5-VL-3B 2025.10		32.41
Contrastive 2025.10		30.17