XQuAD
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multilingual Information Retrieval | XQuAD | Completion@1078.82 | 80 | |
| Label Projection | XQuAD | COMET Score87.3 | 48 | |
| Question Answering | XQuAD | F1 (de)80.5 | 21 | |
| Multilingual Understanding | XQuAD (test) | Accuracy49.47 | 12 | |
| Question Answering | XQuAD | Accuracy64.26 | 12 | |
| Question Answering | XQuAD 1.0 (test) | F1 Score79.6 | 10 | |
| Performance Prediction | XQUAD | MAE3.15 | 9 | |
| Zero-shot performance prediction | XQUAD | MAE2.89 | 9 | |
| Question Answering | XQuAD (test) | F1 Score82.4 | 9 | |
| Question Answering | XQuAD English Distractor I - (X), Q(X & EN) (Avg) | Language Consistency98.23 | 8 | |
| Question Answering | XQuAD Code Switched P, I - (EN), Q(X) (Avg) | Language Consistency100 | 8 | |
| Question Answering | XQuAD Monolingual P, I, Q - (X) (Avg) | Language Consistency100 | 8 | |
| Question Answering | XQuAD v1.1 (test) | F1 (en)89 | 8 | |
| Question Answering | XQuAD seen languages XTREME (test) | F1 Score74.7 | 6 | |
| Question Answering | XQuAD | English QA Score83.9 | 6 | |
| Question Answering | XQuAD vi | Score42.2 | 4 | |
| Question Answering | XQuAD zh | Raw Score27.24 | 4 | |
| Multilingual Question Answering | xquad vi | Normalized Performance89.29 | 3 | |
| Multilingual Question Answering | xquad zh | Normalized Performance60.28 | 3 | |
| Question Answering | XQuAD languages not in MLQA | F1 (el)81.9 | 3 |
Showing 20 of 20 rows