Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SIQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Commonsense ReasoningSIQA
Accuracy89.85
96
Social Interaction Question AnsweringSIQA
Accuracy86.9
85
ReasoningSIQA
Accuracy83.2
44
Social Commonsense ReasoningSIQA
Accuracy85.24
32
Social Commonsense ReasoningSIQA (test)
Accuracy83.3
20
ReasoningSIQA
Accuracy Improvement2.12
12
ReasoningSIQA (val)
Accuracy35.47
9
Commonsense ReasoningSIQA (test)
Accuracy40.28
6
Social ReasoningSIQA
Performance (%)15.2
6
Social Interaction Question AnsweringSIQA
Normalized PLL Score15.4
4
Showing 10 of 10 rows