Our new X account is live! Follow @wizwand_team for updates

Coding on HumanEval

98.17Pass@1

CompassMax-V3-Thinking

Updated 4d ago

Evaluation Results

Method	Links
CompassMax-V3-Thinking 2025.12		98.17
DeepSeek-R1 2025.12		96.95
GPT-4o 2024.10		90.2
Llama-3.1-405B 2025.02		89
Qwen2.5-VL-72B 2025.02		87.8
GPT-4o mini 2024.10		87.2
Qwen2.5-72B 2025.02		86.6
Qwen2-72B-Instruct 2024.07		86
Qwen2-72B 2025.02		86
CompassMax-V3 2025.12		84.76
Gemini-1.5 Pro 2024.10		84.1
Llama-3-70B-Instruct 2024.07		81.7
Llama-3.1-70B 2025.02		80.5
Qwen1.5-110B-Chat 2024.07		74.4
Gemini-1.5 Flash 2024.10		74.3
Mixtral-8x22B-Instruct 2024.07		73.8
ARIA 2024.10		73.2
Llama3.2-11B 2024.10		72.6
Pixtral-12B 2024.10		72
Qwen1.5-72B-Chat 2024.07		71.3
GPT-4V 2024.10		67
Youtu-LLM 2025.12		64.6
ProSeCo Sampling 2026.02		62.2
Llama3.1-Instruct 2026.02		58.54
Qwen3 2025.12		57.6
ProSeCo SFT 2026.02		52.44
Qwen3 2025.12		49.9
Vanilla SFT 2026.02		48.17
Phi-2 2024.07		47.6
LLaDA1.5 2026.02		43.9
Vanilla SFT + ReMDM 2026.02		43.9
LLaDA-Instruct + PRISM 2026.02		42.7
Engram-27B 2026.01		40.8
LLaDA-Instruct 2026.02		40.24
LLaDA-Instruct + ReMDM 2026.02		40.24
HySparse 2026.02		38.4
Engram-40B 2026.01		38.4
MoE-27B 2026.01		37.8
Gemma3 2025.12		36.6
Llama3.1 2025.12		36
Full-Attn 2026.02		35.4
SmolLM3 2025.12		34.8
LLaDA-Base 2026.02		33.54
Hybrid SWA 2026.02		31.7
Qwen2-1.5B 2024.07		31.1
Dense-4B 2026.01		26.8
Full-Attn 2026.02		25
HySparse 2026.02		23.5
Gemma-2B 2024.07		22
Qwen2-0.5B 2024.07		22
Hybrid SWA 2026.02		22
Qwen1.5-1.8B 2024.07		20.1