Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BeyondAIME

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningBeyondAIME
Pass@1669
39
Mathematical ReasoningBeyondAIME
avg@1661.7
23
Mathematical ReasoningBeyondAIME
Mean@8 Score21
18
Mathematical ReasoningBeyondAIME
Accuracy82.5
18
Confidence CalibrationBeyondAIME (test)
SNR Gain1.202
15
ReasoningBeyondAIME
Pass@170.38
14
MathBeyondAIME
Avg@1642.8
12
Math ReasoningBeyondAIME
Accuracy74.8
10
Mathematical Problem SolvingBeyondAIME
Score86.5
9
MathematicsBeyondAIME
Avg@1066.56
9
Mathematical ReasoningBeyondAIME
Pass@18.3
8
Mathematical reasoningBeyondAIME
Score39
7
Claim-level Confidence CalibrationBeyondAIME
SNR Gain0.301
7
Tool-integrated Mathematical ReasoningBeyondAIME
Pass@141
6
Mathematical ReasoningBeyondAIME
Mean@1071.8
4
Mathematical ReasoningBeyondAIME
pass@6431.3
3
Mathematical ReasoningBeyondAIME
Turn 1 Score2
2
Showing 17 of 17 rows