6 languages
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Natural Language Inference | 6 languages Averaged (test) | Accuracy53.4 | 4 | |
| Dependency Labeling | 6 languages Averaged (test) | F1 Score58.8 | 4 | |
| Masked Language Modeling | 6 languages Averaged (test) | MRR42.7 | 4 | |
| Vocabulary Allocation | 6 languages Averaged (test) | AR2,198 | 4 | |
| Sentence Retrieval | 6 languages All transfers | Accuracy27.1 | 4 | |
| Sentence Retrieval | 6 languages (Different script split) | Accuracy0.23 | 4 | |
| Natural Language Inference | 6 languages (Same script split) | Accuracy45.2 | 4 | |
| Natural Language Inference | 6 languages (Different script split) | Accuracy42.4 | 4 | |
| Dependency Labeling | 6 languages Same script | F1 Score27.8 | 4 | |
| Part-of-Speech Tagging | 6 languages All transfers | F1 Score28.8 | 4 | |
| Part-of-Speech Tagging | 6 languages Different script split | F1 Score25.8 | 4 | |
| Named Entity Recognition | 6 languages All transfers | F1 Score38.7 | 4 | |
| Named Entity Recognition | 6 languages (Same script split) | F1 Score59.9 | 4 | |
| Named Entity Recognition | 6 languages Different script | F1 Score33.5 | 4 |
Showing 14 of 14 rows