Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BBH

Benchmarks

Task NameDataset NameSOTA ResultTrend
ReasoningBBH
Accuracy95.4
770
Logical ReasoningBBH
Accuracy100
249
General ReasoningBBH
Accuracy93.2
190
General ReasoningBBH
BBH General Reasoning Accuracy94.6
117
Complex ReasoningBBH
Accuracy90.5
99
ReasoningBBH (test)
Accuracy73.9
94
Instruction InductionBBH Induct
Accuracy91.3
80
ReasoningBBH
BBH Score84.5
53
ReasoningBBH
BBH Accuracy74.99
51
ReasoningBBH
Score81.1
51
ReasoningBBH 3-shot
BBH 3-shot Score65.69
49
ReasoningBBH
BBH Pass@183.69
49
ReasoningBBH
Accuracy67.56
42
Complex ReasoningBBH (val)
Accuracy65.81
42
Causal ReasoningBBH Causal Judgement
Accuracy (BBH Causal Judgement)78
40
Instruction FollowingBBH
Accuracy67.1
40
Multi-domain reasoningBBH
Accuracy87.39
39
Spatial ReasoningBBH Navigate
Accuracy@198
33
Question AnsweringBBH
Accuracy94.6
33
Logical ReasoningBBH (test)
Top@1 Accuracy88.29
29
Complex ReasoningBBH
Accuracy (%)89.14
28
ReasoningBBH
Accuracy (BBH)76.7
28
Deductive ReasoningBBH Ded.
Accuracy92.5
28
Common-sense ReasoningBBH
Accuracy58.27
27
Instruction TuningBBH
Accuracy (BBH)66.2
24
Showing 25 of 104 rows