Tatoeba
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Machine Translation | Tatoeba it->en | sacreBLEU79.0409 | 33 | |
| Machine Translation | Tatoeba en->it | sacreBLEU63.2611 | 33 | |
| Cross-lingual sentence retrieval | Tatoeba Parallel 14 language pairs | Accuracy80.6 | 14 | |
| Bitext Mining | Tatoeba (full) | Accuracy85.4 | 12 | |
| Cross-lingual sentence retrieval (xx → en) | Tatoeba-36 | Average Accuracy@169 | 11 | |
| Cross-lingual sentence retrieval (en → xx) | Tatoeba-36 | Accuracy@176.4 | 11 | |
| Performance Prediction | Tatoeba | MAE5.82 | 9 | |
| Zero-shot performance prediction | Tatoeba | MAE6.16 | 9 | |
| Machine Translation (tr→en) | Tatoeba (test) | BLEU35.7 | 7 | |
| Machine Translation (tr->en) | Tatoeba | ChrF++54.4 | 7 | |
| Machine Translation (en→tr) | Tatoeba (test) | BLEU Score21.1 | 6 | |
| Machine Translation (en->tr) | Tatoeba | ChrF++48.6 | 6 | |
| Cross-lingual sentence retrieval | Tatoeba (test) | af55.2 | 6 | |
| Machine Translation (ko→en) | Tatoeba (test) | BLEU21.8 | 5 | |
| Machine Translation (ru→en) | Tatoeba (test) | BLEU39.4 | 5 | |
| Machine Translation (pt→en) | Tatoeba (test) | BLEU41.3 | 5 | |
| Machine Translation (ko->en) | Tatoeba | ChrF++40.1 | 5 | |
| Machine Translation (ru->en) | Tatoeba | ChrF++57.3 | 5 | |
| Machine Translation (pt->en) | Tatoeba | ChrF++62.4 | 5 | |
| Cross-lingual Sentence Retrieval | Tatoeba | Accuracy93.3 | 4 | |
| Machine Translation (en→ko) | Tatoeba (test) | BLEU13.8 | 4 | |
| Machine Translation (en→ru) | Tatoeba (test) | BLEU29.9 | 4 | |
| Machine Translation (en→pt) | Tatoeba (test) | BLEU33.7 | 4 | |
| Machine Translation (en->ko) | Tatoeba | ChrF++17.4 | 4 | |
| Machine Translation (en->ru) | Tatoeba | ChrF++52.9 | 4 |
Showing 25 of 33 rows