Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Olympiad Bench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningOlympiad Bench
Accuracy76.71
222
Mathematical ReasoningOlympiad Bench
Pass@1 Accuracy68.13
115
Mathematical ReasoningOlympiad Bench
Accuracy85.2
73
Math ReasoningOlympiad Bench
Accuracy55.4
36
Mathematical ReasoningOlympiad Bench
Pass@162.1
35
Mathematical ReasoningOlympiad Bench
Pass@848.5
30
Mathematical ReasoningOlympiad-Bench
Accuracy Pass@146.88
27
Mathematical ReasoningOlympiad Bench
Score68.9
26
Mathematical ReasoningOlympiad Bench (test)
Pass@1 Accuracy83.53
24
Mathematical ReasoningOlympiad bench
Pass@1 Accuracy (@16)57.2
17
Mathematical ReasoningOlympiad Bench
Average@16 Accuracy47.8
15
Mathematical ReasoningOlympiad-Bench
Avg@3258
14
Math and Text ReasoningOlympiad Bench
PAQ73.67
14
Mathematical Problem SolvingOlympiad Bench
Peak Accuracy59.3
12
Mathematical ReasoningOlympiad Bench
Peak Accuracy0.57
12
Mathematical ReasoningOlympiad-Bench
Pass@151.94
12
Mathematical Problem SolvingOlympiad Bench
Pass@8 Accuracy49.1
10
Mathematical ReasoningOlympiad Bench
Accuracy44
9
Mathematical Problem SolvingOlympiad Bench
Pass@1 Accuracy70.36
6
Tool-Integrated ReasoningOlympiad Bench
Test Accuracy52.75
6
Mathematical ReasoningOlympiad Bench
Pass@3269.04
6
Math ReasoningOlympiad Bench
Avg@3241.25
6
Advanced Mathematical Problem SolvingOlympiad Bench N=112
Top-1 Accuracy89.3
5
Mathematical ReasoningOlympiad Bench
Accuracy55.8
4
Mathematical ReasoningOlympiad Bench
Accuracy29.8
4
Showing 25 of 26 rows