Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on Olympiad Bench

68.13Pass@1 Accuracy

MulFeRL

Updated 1mo ago

Evaluation Results

Method	Links
MulFeRL 2026.01		68.13
Critique-GRPO (CoT Critique) 2025.06		66.8
Critique-GRPO (Self-Critique) 2025.06		66.2
R1-GRPO 2025.06		65.6
Critique-GRPO (Self-Critique & Self-Evaluation) 2025.06		65.5
GPT-o1-mini 2025.02		65.3
Critique-GRPO 2026.01		62.4
Dr.GRPO 2026.01		60.36
Pass@8 (Upper Bound) 2025.05		59.4
GRPO 2026.01		59.05
SFT 2026.01		49.17
Critique-GRPO 2025.06		48.6
CITL-FT 2026.01		48.55
RAFT 2026.01		48.34
SCOPE 2025.05		46.8
SFT 2025.06		46.4
Majority @8 2025.05		46.2
SCOPE (Step Skipping) 2025.05		45.8
SCOPE (w/o AST normalization) 2025.05		45.6
SCOPE (w/o code translation) 2025.05		45.5
SCOPE (Step Replacement) 2025.05		45.3
Qwen3-4B-Inst 2026.01		45.13
Qwen2.5-Math-7B-S2R-ORL 2025.02		44.9
RLHFlow-PRM-Deepseek-8B 2025.05		44.3
Qwen3-8B (w/ Think) 2025.06		44.1
Qwen3-8B 2025.06		44.1
Qwen2.5-Math-7B-PRM800K 2025.05		43.5
Oat-Zero 2025.06		43.4
GPT-4o 2025.02		43.3
RLHFlow-PRM-Mistral-8B 2025.05		43.3
GPT-4o-2024-08-06 2024.10		43.3
Skywork-PRM-1.5B 2025.05		43
Skywork-PRM-7B 2025.05		42.8
MulFeRL 2026.01		42.49
Critique-GRPO (CoT Critique) 2025.06		42.4
VI-CuRL 2026.02		42
PRIME-Zero 2025.06		40.3
EurusPRM-Stage1 2025.05		40.2
Progressive Thought Encoding 2026.02		39.7
Math-Shepherd-PRM-7B 2025.05		39.1
LoRA 2026.02		38.7
Progressive Thought Encoding 2026.02		38.7
Critique-GRPO 2026.01		38.64
EurusPRM-Stage2 2025.05		38.5
Qwen2-Math-7B-ScaleQuest 2024.10		38.5
Greedy 2025.05		38.2
Qwen2-Math-7B-Instruct 2024.10		37.8
GRPO 2026.01		36.77
MathScale 2025.04		36.4
RV-Syn 2025.04		36.4
Official Model 2025.04		36
LoRAc 2026.02		35.9
Dr.GRPO 2026.01		35.79
Orca-Math 2025.04		35.4
LoRA 2026.02		35.3
MetaMath 2025.04		35
VI-CuRL 2026.02		34.8
PromptCoT 2025.04		34.8
Mammoth2 2025.04		34.7
Jiuzhang3.0 2025.04		34.7
Baseline 2026.02		34.7
SimpleRL-Zero 2025.06		34.7
ScaleQuest 2025.04		34.4
Qwen2-Math-7B-Numina-Math 2024.10		33.6
LoRAc 2026.02		31.9
CITL-FT 2026.01		30.89
Qwen2.5-7B-Base 2025.06		30.4
DeepSeekMath-7B-ScaleQuest 2024.10		29.9
RAFT 2026.01		29.58
Progressive Thought Encoding 2026.02		29
Baseline 2026.02		28.7
Qwen2.5-7B-Base 2026.01		28.13
LoRA 2026.02		27.8
LoRAc 2026.02		27.7
SFT 2026.01		27.27
Baseline 2026.02		27.2
Mistral-7B-ScaleQuest 2024.10		26.8
Qwen2-7B-S2R-ORL 2025.02		26.2
Llama3-8B-ScaleQuest 2024.10		25.3
Qwen2-Math-7B-DART-Math 2024.10		23.1
RV-Syn 2025.04		22.4
ScaleQuest 2025.04		21.8
DeepSeekMath-7B-DART-Math 2024.10		21.7
Mammoth2 2025.04		21.3
PromptCoT 2025.04		21.3
Llama-3.1-8B-S2R-ORL 2025.02		20.7
MetaMath 2025.04		20.7
MathScale 2025.04		20.3
DeepSeekMath-7B-Numina-Math 2024.10		19.9
Orca-Math 2025.04		19.6
Jiuzhang3.0 2025.04		19.6
Mistral-7B-NuminaMath 2024.10		19.4
DeepSeekMath-7B-RL 2024.10		19
Qwen2-Math-7B-MetaMath 2024.10		17.9
Llama3-8B-NuminaMath 2024.10		17.8
Qwen2.5-Math-7B-Base 2025.06		17.6
RV-Syn 2025.04		16.4
Jiuzhang3.0 2025.04		15.9
PromptCoT 2025.04		15.7
Official Model 2025.04		15.7

Showing 100 of 115 rows