Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OlympiadBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningOlympiadBench Math
Accuracy99.86
84
Mathematical ReasoningOlympiadBench
Accuracy65.3
82
Mathematical ReasoningOlympiadBench
Accuracy82.44
81
Mathematical ReasoningOlympiadBench
Accuracy0.7659
72
Mathematical ReasoningOlympiadBench Math (test)
Accuracy35.9
59
Mathematical ReasoningOlympiadBench
Accuracy65.81
57
Multimodal Mathematical ReasoningOlympiadBench
Accuracy68
56
Math ReasoningOlympiadBench
Accuracy90.7
54
Math ReasoningOlympiadBench
Accuracy70.3
44
Mathematical ReasoningOlympiadBench
Pass@162.1
39
Mathematical ReasoningOlympiadBench
Pass Rate60.67
36
Mathematical ReasoningOlympiadBench
EM57.9
36
MathematicsOlympiadBench
Pass@1 Accuracy57
32
Mathematical ReasoningOlympiadBench
MV Score24.29
27
Mathematical ReasoningOlympiadBench
Accuracy (avg@4)73.78
26
Mathematical ReasoningOlympiadBench
Accuracy0.44
24
Mathematical ReasoningOlympiadBench
Pass@861.2
24
Mathematical ReasoningOlympiadBench
Avg Success Rate @844.25
23
Mathematical ReasoningOlympiadBench
Avg@860.9
21
Mathematical ReasoningOlympiadBench
Accuracy (%)73.8
20
Mathematical ReasoningOlympiadBench
Pass@166.91
20
Math ReasoningOlympiadBench
Pass@1 Accuracy48.2
19
Mathematical ReasoningOlympiadBench OE_TO_mat_en_COMP
Accuracy57.73
18
Advanced Mathematical ReasoningOlympiadBench
Accuracy12.8
18
Mathematical ReasoningOlympiadBench
Accuracy60.44
18
Showing 25 of 81 rows