NewsQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | NewsQA (dev) | F1 Score75.5 | 101 | |
| Question Answering | NewsQA | F180.5 | 67 | |
| Uncertainty Estimation | NewsQA | AUROC76.6 | 42 | |
| Question Answering | NewsQA (test) | F173.6 | 40 | |
| Membership Inference Attack | newsQA | AUC92.9 | 39 | |
| Extractive Question Answering | NewsQA MRQA | F172.6 | 22 | |
| Question Answering | NewsQA trained on SQuAD OOD (test) | F1 Score52.41 | 20 | |
| Question Answering | NewsQA Short-doc | R@166.43 | 16 | |
| Extractive Question Answering | NewsQA | F1 Score59.7 | 14 | |
| Question Answering | NewsQA trained on CausalQA OOD (test) | F1 Score9.54 | 10 | |
| Short-form single-page QA | NewsQA (official) | EM39 | 9 | |
| Document Privacy Erasure | NewsQA | r_pub43.55 | 7 | |
| Sentence Selection | NewsQA (dev) | Accuracy94.6 | 7 | |
| Question Answering | NewsQA | Score66.8 | 6 | |
| Question Answering | NewsQA | Latency (s)112.36 | 3 | |
| Document Retrieval | NewsQA | Recall@193.3 | 2 |
Showing 16 of 16 rows