Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

QA Tasks

Benchmarks

Task NameDataset NameSOTA ResultTrend
Question Answering5 QA tasks
Accuracy54.02
78
Question Answering7 QA tasks
Accuracy69.44
42
Question AnsweringQA Tasks (unseen)
AN' Score42.12
14
Question AnsweringQA Tasks seen (test)
AN59.23
14
Question AnsweringQA Tasks (OpenBookQA, PIQA, ARC-E, ARC-C, SciQ, WebQs) (test)
OpenBookQA0.394
12
Question AnsweringSeen QA Tasks
SQuAD 279.99
8
Showing 6 of 6 rows