Share your thoughts, 1 month free Claude Pro on usSee more

Counting on TallyQA

80.8Accuracy

Molmo

Updated 1mo ago

Evaluation Results

Method	Links
Molmo 2026.01		80.8
Qwen2.5-VL 2026.01		80
LLaVA-OneVision 2026.01		79.7
PaliGemma 2026.01		79.4
LLaVA-NeXT 2026.01		73.3
SmolVLM2 2026.01		72.9
LLaVA-AIMv2 2026.01		71
LLaVA v1.5 2026.01		70.7
LLaVA-AIMv2-2D-RoPE 2026.01		69
LLaVA-SigLIP2 2026.01		68.4
LLaVA-SigLIP 2026.01		67.2
LLaVA-2D-RoPE 2026.01		65.4
LLaVA-SigLIP2-2D-RoPE 2026.01		64.6
LLaVA-SigLIP-2D-RoPE 2026.01		61.6
GPT-5-mini 2025.12		55.4
GPT-5-mini 2025.12		55.2
Gemma3-4b-it 2026.01		52.5
VALOR 2025.12		51
VALOR 2025.12		51
Claude-3.5-Haiku 2025.12		50.1
Qwen3-8B 2025.12		50.1
GPT-4o 2025.12		49.9
VALOR-RL 2025.12		49.5
Gemini-2.5-Flash 2025.12		48.9
Gemma-3-12B 2025.12		48.9
o4-mini 2025.12		47.9
Llama-3.2-11B 2025.12		47.7
Gemini-2.0-Flash 2025.12		43.6