Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GSM8K

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningGSM8K
Accuracy97.1
1,362
Mathematical ReasoningGSM8K (test)
Accuracy99
900
Mathematical ReasoningGSM8K (test)
Accuracy97.72
770
Mathematical ReasoningGSM8K
Accuracy98
499
Mathematical ReasoningGSM8K
Accuracy (GSM8K)97.8
358
Mathematical ReasoningGSM8k
Accuracy96.21
312
Mathematical ReasoningGSM8K
Speed Up (x)13.4
246
MathGSM8K
Accuracy0.988
206
Mathematical ReasoningGSM8K
Math Score96.4
197
Math ReasoningGSM8K (test)
Accuracy94.5
192
Math reasoningGSM8K
Accuracy95.15
187
Arithmetic ReasoningGSM8K
Accuracy97.1
173
Arithmetic ReasoningGSM8K (test)
Accuracy97.35
129
Math ReasoningGSM8K
Accuracy93.8
126
Mathematical ReasoningGSM8K
EM97.04
123
Math Word Problem SolvingGSM8K
Accuracy96.8
111
ReasoningGSM8K
Accuracy1
106
Mathematical ReasoningGSM8K
pass@196.7
102
Mathematical reasoningGSM8K
Tau ($ au$)6.92
97
Hallucination DetectionGSM8K
AUROC90.37
93
Math Word Problem SolvingGSM8K
Accuracy95.3
87
Mathematical ReasoningGSM8K (val)
Accuracy90.8
81
Mathematical ReasoningGSM8K (test)
Accuracy89.2
79
Grade School Math ReasoningGSM8K
Accuracy (GSM8K)95.1
77
Mathematical ReasoningGSM8K
Accuracy93
66
Showing 25 of 482 rows
...