Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HellaSwag

Benchmarks

Task NameDataset NameSOTA ResultTrend
Commonsense ReasoningHellaSwag
Accuracy99.21
1,896
Commonsense ReasoningHellaSwag
HellaSwag Accuracy87.4
897
Sentence CompletionHellaSwag
Accuracy87.5
440
Common sense reasoningHellaswag
Accuracy93.87
213
Multiple Choice Question AnsweringHellaSwag
Accuracy93.59
212
ReasoningHellaSwag (HS)
HellaSwag Accuracy91.84
209
Commonsense InferenceHellaSwag
Accuracy88.97
171
Commonsense ReasoningHellaSwag
Accuracy86.63
106
Common Sense ReasoningHellaSwag (test)
Accuracy83.9
86
Common Sense ReasoningHellaSwag
Accuracy91.84
85
Commonsense ReasoningHellaSwag (val)
Accuracy95.3
68
Commonsense ReasoningHellaSwag (HS)
HS Accuracy78.94
66
Commonsense ReasoningHellaSwag
Normalized Accuracy90.92
66
Commonsense ReasoningHellaSwag
HellaSwag Score86.86
62
Commonsense ReasoningHellaSwag
HellaSwag Score95.45
55
Commonsense ReasoningHellaSwag
HellaSwag Score86
53
Zero-shot ReasoningHellaSwag
Accuracy76.3
53
Common Sense ReasoningHellaSwag 0-shot
Accuracy84.4
49
Common Sense ReasoningHellaSwag
Accuracy (acc_n)95.7
47
Commonsense ReasoningHellaSwag
Accuracy95.1
47
Commonsense ReasoningHellaSwag
HS Accuracy78.9
44
Commonsense ReasoningHellaswag
HS Score50
43
Zero-shot PredictionHellaSwag
Zero-shot HellaSwag Accuracy76.36
43
Commonsense ReasoningHellaSwag
Zero-shot Accuracy60.04
36
General KnowledgeHellaSwag
Accuracy91.7
36
Showing 25 of 149 rows