Our new X account is live! Follow @wizwand_team for updates

Mathematical Reasoning on GaoKao En 2023

79.7Pass@1 Accuracy

Pass@8 (Upper Bound)

Updated 4d ago

Evaluation Results

Method	Links
Pass@8 (Upper Bound) 2025.05		79.7
GPT-o1-mini 2025.02		78.4
SCOPE (w/o AST normalization) 2025.05		72.2
SCOPE 2025.05		71.9
SCOPE (Step Skipping) 2025.05		71.7
SCOPE (Step Replacement) 2025.05		71
RLHFlow-PRM-Mistral-8B 2025.05		70.9
Skywork-PRM-7B 2025.05		70.9
Skywork-PRM-1.5B 2025.05		70.6
SCOPE (w/o code translation) 2025.05		70.6
Qwen2.5-Math-7B-PRM800K 2025.05		70.5
Majority @8 2025.05		70.4
Qwen2.5-Math-7B-S2R-ORL 2025.02		70.1
RLHFlow-PRM-Deepseek-8B 2025.05		69.9
GPT-4o 2025.02		67.5
EurusPRM-Stage1 2025.05		66.1
EurusPRM-Stage2 2025.05		65.8
Greedy 2025.05		64.2
Math-Shepherd-PRM-7B 2025.05		63.6
Qwen2-7B-S2R-ORL 2025.02		50.9
Llama-3.1-8B-S2R-ORL 2025.02		45.2