Planning on AutoLogic

89.1Accuracy

Qwen3-Base (DICE-PC)

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-Base (DICE-PC) 2026.06		89.1
OpenAI o3 2026.06		89
Qwen3-235B-A22B 2026.06		88.9
Qwen3-Base (DICE-FT) 2026.06		88.3
Qwen3-A3B 2026.06		88.1
Qwen3 (thinking) 2026.06		87.3
Qwen3-Inst (SC@64) 2026.06		87.1
QwQ 2026.06		86.3
OpenAI o3-mini 2026.06		86.3
Qwen3-Base Debate+Judge (FT) 2026.06		85.9
Qwen3-Inst Debate+Judge (prompt) 2026.06		85.5
Qwen3-Base Role-play (FT) 2026.06		85.5
Qwen3-Base Debate+Judge (FT) 2026.06		85.3
Qwen3-Base Debate (FT) 2026.06		85.1
Qwen3-Base Role-play (FT) 2026.06		85
Qwen3-Inst Role-play (prompt) 2026.06		84.8
Qwen3-Base Debate (FT) 2026.06		84.6
Qwen3-Inst Debate (prompt) 2026.06		84.2
Llama 3.1-Base (DICE-PC) 2026.06		83.9
DeepSeek-R1 Distill 2026.06		83.5
Qwen3-Inst (Few-shot CoT) 2026.06		83
Qwen3-Base-DAPO 2026.06		82.1
Qwen3-Base-GRPO 2026.06		81.4
Qwen3-Base-DAPO 2026.06		80.9
Qwen3-Inst (ReAct) 2026.06		80.6
Qwen3-Base-GRPO 2026.06		80.3
Qwen3-Base-PPO 2026.06		79.9
Qwen3-Base 2026.06		79.1
Qwen3-Base 2026.06		78.5
Qwen3-Inst (SC@64) 2026.06		78.1
Qwen3-Inst (ToT) 2026.06		77.8
Qwen2.5-Base 2026.06		76.7
Qwen3-Inst (Zero-shot CoT) 2026.06		63.5
GPT-4o-mini 2026.06		62.5