Share your thoughts, 1 month free Claude Pro on usSee more

Mathematics on OlympiadBench (pass@1 %)

78.72Pass@1 Accuracy

COSE

Updated 1d ago

Evaluation Results

Method	Links
COSE 2026.05		78.72
COSE 2026.05		72
MAE 2026.05		69.4
R-Zero 2026.05		68.9
AZR 2026.05		68.6
Base 2026.05		66.8
INSIGHT 2026.03		57
MoPPS 2026.03		56.45
RANDOM 2026.03		56.24
INVERSE-EVIDENCE 2026.03		56.2
DS 2026.03		53.38
INSIGHT 2026.03		52.5
EXPECTED-DIFFICULTY 2026.03		52.25
INVERSE-EVIDENCE 2026.03		52.07
MoPPS 2026.03		52.01
RANDOM 2026.03		51.8
Scaf-GRPO 2025.10		50.7
Vanilla GRPO 2025.10		50.2
MAE 2026.05		47.6
R-Zero 2026.05		46.3
DeepSeek-R1-Distill-Qwen-1.5B 2025.10		45.8
AZR 2026.05		44.2
Scaf-GRPO 2025.10		43.3
LUFFY 2025.10		41.7
Vanilla GRPO 2025.10		41.3
Oat-Zero 2025.10		41
Scaf-GRPO 2025.10		40.8
Vanilla GRPO 2025.10		40.4
Base 2026.05		38.1
SimpleRL-Zero 2025.10		37.2
Scaf-GRPO 2025.10		36.6
Vanilla GRPO 2025.10		34.8
INVERSE-EVIDENCE 2026.03		34.8
INSIGHT 2026.03		34.8
Qwen2.5-7B 2025.10		34.4
MoPPS 2026.03		34.25
RANDOM 2026.03		34.2
Qwen2.5-Math-1.5B 2025.10		20.6
Scaf-GRPO 2025.10		20.3
IPPO (MAPoRL) 2025.04		19.05
MARFT 2025.04		18.72
MARFT 2025.04		18.55
MARFT 2025.04		18.43
IPPO (MAPoRL) 2025.04		18.37
IPPO (MAPoRL) 2025.04		18.31
Vanilla GRPO 2025.10		18.3
Qwen2.5-Math-7B 2025.10		18.2
Vanilla 2025.04		17.6
Vanilla 2025.04		16.6
Vanilla 2025.04		16.08
Llama-3.2-3B-Instruct 2025.10		12.6