SearchQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Web Search Question Answering | SearchQA held-out (test) | Score (%)87.3 | 59 | |
| Question Answering | SearchQA (test) | N-gram F175.1 | 48 | |
| Question Answering | SearchQA | EM78 | 46 | |
| Question Answering | SearchQA | Accuracy95.1 | 30 | |
| Question Answering | SearchQA (dev) | F1 (N-gram)68.5 | 28 | |
| Extractive Question Answering | SearchQA MRQA | F1 Score83 | 22 | |
| Search-based Question Answering | SearchQA | Hotpot Score42 | 18 | |
| Uncertainty Estimation | SQW (SearchQA) | AUROC0.83 | 18 | |
| Open-domain Question Answering | SearchQA | EM61.96 | 13 | |
| Retrieval-Augmented Generation | SearchQA | Accuracy94.51 | 9 | |
| QA retrieval | SearchQA | P@10.587 | 8 | |
| Question Answering | SearchQA (val) | EM49.6 | 7 | |
| Reading Comprehension | SearchQA (test) | EM56.8 | 4 |
Showing 13 of 13 rows