Our new X account is live! Follow @wizwand_team for updates

Coding on MBPP+

86.21Pass@1

Gemini 3-Pro

Updated 3d ago

Evaluation Results

Method	Links
Gemini 3-Pro 2026.02		86.21
GPT-5 (High) 2026.02		83.1
ERNIE 5.0 2026.02		82.54
Llama-3.1-8B-inst 2026.01		81.8
Youtu-LLM 2025.12		81.8
DS V3.2-Thinking 2026.02		81.48
Qwen3 2025.12		80.8
Exaone-3.5-7.8B-inst 2026.01		79.4
Mi:dm 2.0 Base-inst 2026.01		77.5
Gemini 2.5-Pro 2026.02		73.8
Qwen3-14B 2026.01		73.4
Qwen3 2025.12		71
Qwen 3 VL 32B Instruct 2025.12		69
Qwen 3 32B 2025.12		67.9
Qwen 2.5 32B 2025.12		66.6
SmolLM3 2025.12		66.1
Gemma 3 27B 2025.12		65.7
Olmo 3.1 32B Instruct 2025.12		65.1
Olmo 3.1 32B Instruct 2025.12		63.6
Llama3.1 2025.12		62.7
Qwen3-4B 2026.01		62.4
Qwen3-8B 2026.01		62.2
Gemma3 2025.12		61.9
Olmo 3.1 32B Instruct 2025.12		61.5
Gemma 2 27B 2025.12		61.2
Mi:dm 2.0 Mini-inst 2026.01		60.9
OLMo3-7B-Instruct 2026.01		60.2
Exaone-3.5-2.4B-inst 2026.01		59.8
Qwen3-4B 2026.01		59.5
Molmo2-8B 2026.01		57.5
Molmo2-4B 2026.01		56.2
Molmo2-O-7B 2026.01		55.7
OLMo 2 32B 2025.12		49
Apertus 70B 2025.12		45.8
CDLM 2025.12		22.6
MDLM 2025.12		13.7
Base 2025.12		12