Trivia QA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Trivia QA | Trivia QA | Accuracy82.2 | 32 | |
| Passage Retrieval | Trivia QA (TQA) | Top-20 Accuracy81.3 | 17 | |
| Question Answering | Trivia QA | Error Rate (ER)5.9 | 12 | |
| Question Answering | Trivia QA Hard | F1 Score37.83 | 9 | |
| Open-Domain Question Answering | Trivia QA | Trivia QA Score52.51 | 7 | |
| Short-form Question Answering | Trivia QA | AUROC85.9 | 7 | |
| Retrieval | Trivia QA (test) | R@2083.2 | 6 | |
| Membership Inference Attack Defense | Trivia-QA | SPV AUC0.491 | 4 | |
| Membership Inference Attack Defense | Trivia-QA (test) | SPV AUC0.55 | 4 |
Showing 9 of 9 rows