Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on GSM8k (Pass@1 Acc)

86Pass@1 Accuracy

+10k SFT (Random)

Updated 1mo ago

Evaluation Results

Method	Links
+10k SFT (Random) 2026.04		86
STAT-Syn 2026.04		85
AUTOSKILL 2026.04		84.5
ReasonFlux-PRM 2026.04		81.5
AUTOSKILL 2026.04		77.5
s1K-1.1 (DeepSeek) 2026.04		77
+1k SFT (Random) 2026.04		76.25
AUTOSKILL 2026.04		73.43
Difficulty-low 2026.04		73
Remove-outliers 2026.04		72.5
Long-examples 2026.04		72.25
Correctness-low 2026.04		72.25
Deduplication 2026.04		71.75
Repetition-low 2026.04		71.75
Best Heuristic 2026.04		71.75
AUTOSKILL 2026.04		70.75
Difficulty-high 2026.04		70.62
Best Heuristic 2026.04		70.62
Repetition-low 2026.04		70.56
+25k SFT (Random) 2026.04		70.46
+25k SFT (Random) 2026.04		70
Long-examples 2026.04		69
Correctness-high 2026.04		68.5
LIMO 2026.04		68.25
Difficulty-high 2026.04		67
ReasonFlux-PRM 2026.04		65.75
Remove-outliers 2026.04		65.62
Qwen2.5-3B 2026.04		56.62
ReasonFlux-PRM 2026.04		56
STAT-Sel 2026.04		49
s1K-1.1 (Gemini) 2026.04		44.75
Llama3-8B-Instruct 2026.04		44.25