FLORES
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Machine Translation | Flores | BLEU Score40.91 | 97 | |
| Machine Translation | FLORES | Average Score89.07 | 47 | |
| Machine Translation | Flores-200 Romance group xx->en (test) | BLEU42.88 | 46 | |
| Machine Translation | FLORES | Score88.9 | 43 | |
| Machine Translation | FLORES-200 (devtest) | Delta CHRF++5.67 | 39 | |
| Machine Translation | FLORES xx→en (test) | Score (de→en)-65.05 | 38 | |
| Machine Translation | FLORES-200 XX ⇔ XX | XCOMET-XXL Score88.74 | 30 | |
| Machine Translation | FLORES-200 ZH ⇔ XX | XCOMET-XXL90.3 | 30 | |
| Machine Translation | FLORES Medium Resource | BLEU (En→X)38.33 | 27 | |
| Machine Translation | FLORES High Resource | En->X BLEU38.34 | 27 | |
| Steered Language Generation | FLORES+ | Score (es)24 | 27 | |
| Machine Translation | FLORES EN-ZH | COMETkiwi90.08 | 26 | |
| Intrinsic Tokenization | FLORES+ (test) | Vocabulary Utilisation69.2 | 24 | |
| Machine Translation | FLORES Low Resource | BLEU (En->X)39.32 | 24 | |
| Machine Translation | FLORES-200 | COMET79.23 | 23 | |
| English-to-Chinese translation | FLORES-200 | GRF91.42 | 21 | |
| Machine Translation | FLORES-200 XX ⇔ XX 2022 | XCOMET-XXL87.73 | 17 | |
| Machine Translation | FLORES-200 EN ⇔ XX 2022 | XCOMET-XXL94.13 | 17 | |
| Machine Translation | FLORES-200 ZH ⇔ XX 2022 | XCOMET-XXL0.8982 | 17 | |
| Machine Translation | Flores-101 (val test) | CHRF46.8 | 17 | |
| Translation | FLoRes+ En-YY (total) | ChrF++44.6 | 16 | |
| Translation | FLoRes+ En-YY mid resource level | ChrF++46.5 | 16 | |
| Translation | FLoRes+ En-YY, high resource level | ChrF++58.6 | 16 | |
| Translation | FLoRes+ XX-En, low resource level | ChrF++54.6 | 16 | |
| Translation | FLoRes+ XX-En mid resource level | ChrF++58.3 | 16 |
Showing 25 of 202 rows
...