Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Trivia QA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Trivia QATrivia QA
Accuracy82.2
32
Passage RetrievalTrivia QA (TQA)
Top-20 Accuracy81.3
17
Question AnsweringTrivia QA
Error Rate (ER)5.9
12
Question AnsweringTrivia QA Hard
F1 Score37.83
9
Open-Domain Question AnsweringTrivia QA
Trivia QA Score52.51
7
Short-form Question AnsweringTrivia QA
AUROC85.9
7
RetrievalTrivia QA (test)
R@2083.2
6
Membership Inference Attack DefenseTrivia-QA
SPV AUC0.491
4
Membership Inference Attack DefenseTrivia-QA (test)
SPV AUC0.55
4
Showing 9 of 9 rows