EntityQuestions
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | EntityQuestions Frequent | Exact Match Accuracy38.7 | 16 | |
| Question Answering | EntityQuestions (Infrequent) | Exact Match (EM)38.6 | 16 | |
| Question Answering | EntityQuestions (Long-tail) | Exact Match Accuracy36.4 | 16 | |
| Open-Domain Question Answering Retrieval | EntityQuestions (test) | Accuracy@2076.3 | 15 | |
| Retrieval | ENTITYQUESTIONS Infrequent | Recall@1075.4 | 14 | |
| Question Answering | EntityQuestions | Accuracy69.5 | 13 | |
| Information Retrieval | EntityQuestions (test) | Recall@20 (macro average)74.5 | 11 | |
| Passage Retrieval | EntityQuestions unseen query distribution (test) | Accuracy@200.662 | 8 | |
| Retrieval | ENTITYQUESTIONS Frequent | Recall@1071.5 | 7 | |
| Retrieval | ENTITYQUESTIONS Long-tail | Recall@1054.6 | 7 | |
| Retrieval | ENTITYQUESTIONS (Frequent) | Recall@1081.9 | 7 | |
| Retrieval | ENTITYQUESTIONS Long-tail | Recall@100.726 | 7 | |
| Open-domain Question Answering | EntityQuestions (ENTITYQ) (test) | EM28.3 | 7 | |
| Information Retrieval | EntityQuestions | Acc@2079.8 | 4 |
Showing 14 of 14 rows