Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on Math500 (Accuracy (%))

93Accuracy (%)

SPIRAL

Updated 1mo ago

Evaluation Results

Method	Links
SPIRAL 2025.06		93
SafeX 2026.05		92.2
SFT 2025.06		91.8
RTT-AON 2026.04		91.8
MESA 2026.05		91
DeepSeek-Distill-Qwen-7B 2025.06		90.8
Base(instruct) 2026.05		90.6
GRPO 2026.05		90.2
Qwen3-4B-Instruct 2026.04		87.2
SPIRAL 2025.06		86.6
ConSteer-RL 2026.06		86.6
GRPO 2026.06		86
ConSteer-RL 2026.06		85.8
Seq-ALP 2026.03		84.29
Stair-SFT 2026.05		83.8
GRPO 2026.06		83.6
Token-ALP 2026.03		83.48
Token-MIS 2026.03		83.29
Stair-DPO 2026.05		83.2
SFT 2025.06		82.8
Seq-Bypass 2026.03		81.74
GRPO 2026.03		80.9
Seq-MIS 2026.03		80.61
ConSteer-RL 2026.06		78.4
SPIRAL 2025.06		78.2
GRPO 2026.06		77.6
Qwen3-8B-Base 2025.06		77
Baseline 2026.06		76.6
SPIRAL 2025.06		76.4
Qwen2.5-7B-Instruct 2026.04		74.8
SFT 2025.06		74.2
SFT 2025.06		74
RTT-AON 2026.04		73.8
Qwen3-4B-Base 2025.06		73.4
Baseline 2026.06		71.4
SFT 2026.05		69.2
SPIRAL 2025.06		68.6
SFT 2025.06		66
Octothinker-8B-Base 2025.06		65.6
Baseline 2026.06		65
SFT 2025.06		51.8
SPIRAL 2025.06		49.8
Llama-3.1-8B-Instruct 2025.06		46.4
GRPO 2026.05		43.67
GRPO + WeMask (TF) 2026.05		43.47
GRPO + WeMask (TA) 2026.05		43.33
Qwen3-4B 2026.05		43
RTT-AON 2026.04		40
Llama3.2-3B-Instruct 2026.04		36.6
MESA 2026.05		28.8
GRPO 2026.05		28.2
Base(chat) 2026.05		24.8
SafeX 2026.05		24.2
Stair-SFT 2026.05		16.4
SFT 2026.05		15
Stair-DPO 2026.05		14.4