TyDiQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multilingual Question Answering | TydiQA | Accuracy81.9 | 65 | |
| Hallucination Detection | TyDiQA-GP | AUC ROC0.9404 | 46 | |
| Multilingual Question Answering | TyDiQA 1-shot macro-averaged | F1 Score (1-shot macro)48.86 | 28 | |
| Question Answering | TyDiQA | Exact Match52.14 | 28 | |
| Instruction Tuning | TyDiQA | Accuracy67.41 | 20 | |
| Multilingual Question Answering | TyDiQA GoldP (val) | Ar Score80 | 20 | |
| Question Answering | TyDiQA GoldP | F1 Score89.4 | 20 | |
| Multilinguality | TydiQA | F1 Score70.8 | 16 | |
| Hallucination Detection | TyDiQA (test) | AUROC88.4 | 14 | |
| Multilingual Understanding | TydiQA (test) | Accuracy47.78 | 12 | |
| Question Answering | TyDiQA GoldP (test) | F1 Score87.7 | 12 | |
| Question Answering | TYDIQA | Accuracy56.62 | 11 | |
| Performance Prediction | TyDiQA | MAE4.29 | 9 | |
| Zero-shot performance prediction | TyDiQA | MAE3.42 | 9 | |
| Question Answering | TyDiQA | Score53.56 | 6 | |
| Multilingual Question Answering | TydiQA | F1 Score48.71 | 4 | |
| Question Answering | TyDiQA (test) | Average Score72.4 | 4 |
Showing 17 of 17 rows