Share your thoughts, 1 month free Claude Pro on usSee more

Planning on PlanBench-BW NL

42.7Accuracy (%)

Qwen3-Base SAT

Updated 2mo ago

Evaluation Results

Method	Links
Qwen3-Base SAT 2026.04		42.7
OpenAI o3-mini (medium) 2026.04		41.2
Qwen3 (thinking) 2026.04		40.3
Qwen3-A3B 2026.04		39.1
DeepSeek-R1 Distill Llama 2026.04		39.1
Qwen3-Base Debate + Judge 2026.04		39.1
Qwen3-Base Role-play 2026.04		38.7
Qwen3-Base Debate 2026.04		38.3
QwQ 2026.04		37.9
Llama 3.1-Base SAT 2026.04		37.1
GPT-4o-mini-2024-07-18 2026.04		34.7
Qwen3-Base 2026.04		34.3
Qwen2.5-Base 2026.04		33.7
Qwen3-Base-DAPO 2026.04		33.5
Qwen3-Base-GRPO 2026.04		33.1
Qwen3-Base 2026.04		29.7