Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on GaoKao En 2023

79.7Pass@1 Accuracy

Pass@8 (Upper Bound)

Updated 1mo ago

Evaluation Results

Method	Links
Pass@8 (Upper Bound) 2025.05		79.7
GPT-o1-mini 2025.02		78.4
Scaf-GRPO 2025.10		72.3
SCOPE (w/o AST normalization) 2025.05		72.2
SCOPE 2025.05		71.9
SCOPE (Step Skipping) 2025.05		71.7
Vanilla GRPO 2025.10		71.4
SCOPE (Step Replacement) 2025.05		71
RLHFlow-PRM-Mistral-8B 2025.05		70.9
Skywork-PRM-7B 2025.05		70.9
Skywork-PRM-1.5B 2025.05		70.6
SCOPE (w/o code translation) 2025.05		70.6
Qwen2.5-Math-7B-PRM800K 2025.05		70.5
Majority @8 2025.05		70.4
Qwen2.5-Math-7B-S2R-ORL 2025.02		70.1
RLHFlow-PRM-Deepseek-8B 2025.05		69.9
GPT-4o 2025.02		67.5
EurusPRM-Stage1 2025.05		66.1
EurusPRM-Stage2 2025.05		65.8
Greedy 2025.05		64.2
Vanilla GRPO 2025.10		64.2
Scaf-GRPO 2025.10		63.8
Math-Shepherd-PRM-7B 2025.05		63.6
Scaf-GRPO 2025.10		63.4
Oat-Zero 2025.10		62.9
LUFFY 2025.10		62.7
Vanilla GRPO 2025.10		62.6
DeepSeek-R1-Distill-Qwen-1.5B 2025.10		62.1
SimpleRL-Zero 2025.10		60.8
Scaf-GRPO 2025.10		57.9
Vanilla GRPO 2025.10		57.4
Qwen2-7B-S2R-ORL 2025.02		50.9
Scaf-GRPO 2025.10		46
Vanilla GRPO 2025.10		45.7
Llama-3.1-8B-S2R-ORL 2025.02		45.2
Qwen2.5-7B 2025.10		42.6
Qwen2.5-Math-7B 2025.10		35.1
Llama-3.2-3B-Instruct 2025.10		33.5
Qwen2.5-Math-1.5B 2025.10		20