| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | SearchQA (test) | N-gram F175.1 | 48 | |
| Question Answering | SearchQA (dev) | F1 (N-gram)68.5 | 28 | |
| Extractive Question Answering | SearchQA MRQA | F1 Score83 | 22 | |
| Question Answering | SearchQA | EM78 | 14 | |
| Open-domain Question Answering | SearchQA | EM61.96 | 13 | |
| QA retrieval | SearchQA | P@10.587 | 8 | |
| Question Answering | SearchQA (val) | EM49.6 | 7 | |
| Reading Comprehension | SearchQA (test) | EM56.8 | 4 |