Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Mathematical Reasoning on BIGMATH (Competition Subsets and Pass@8)
Loading...
49.95
MATH500 Score
RLVR
36.7108
40.1479
43.585
47.0221
Oct 10, 2025
MATH500 Score
AIME24 Score
AIME25 Score
AMC23 Score
AMC24 Score
HMMT24 Score
Average Pass@8 Score
Pass@8 Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
MATH500 Score
AIME24 Score
AIME25 Score
AMC23 Score
AMC24 Score
HMMT24 Score
Average Pass@8 Score
Pass@8 Score
RLVR
Backbone=LLAMA-3.1-8B-...
2025.10
49.95
5
3.33
26.25
18.13
1.25
17.32
37.31
RLER
Backbone=LLAMA-3.1-8B-...
2025.10
48.35
4.17
2.92
23.75
16.67
1.25
16.19
35.07
INTUITOR
Backbone=LLAMA-3.1-8B-...
2025.10
46.25
3.33
2.5
21.56
12.78
0.42
14.47
31.72
pre-RL
Backbone=LLAMA-3.1-8B-...
2025.10
45.75
3.75
0
19.38
12.22
0
13.52
30.2
SC
Backbone=LLAMA-3.1-8B-...
2025.10
42.65
2.5
2.08
24.37
12.78
0
14.06
30.85
Judge
Backbone=LLAMA-3.1-8B-...
2025.10
37.22
0.42
1.25
15.62
10.83
0
10.89
25.39
Feedback
Search any
task
Search any
task